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Abstract 

In this paper the integer-valued autoregressive model of order one, contaminated with 
additive or innovational outliers is studied in some detail. Moreover, parameter estimation 
is also addressed. Supposing that the time points of the outliers are known but their 
^ . sizes are unknown, we prove that the Conditional Least Squares (CLS) estimators of the 

offspring and innovation means are strongly consistent. In contrast, however, the CLS 
i estimators of the outliers' sizes are not strongly consistent, although they converge to a 

I random limit with probability 1. This random limit depends on the values of the process 

I at the outliers' time points and on the values at the preceding time points and in case 

' of additive outliers also on the values at the following time points. We also prove that 

■ the joint CLS estimator of the offspring and innovation means is asymptotically normal. 

Conditionally on the above described values of the process, the joint CLS estimator of the 
^ . sizes of the outliers is also asymptotically normal. 
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1 Introduction 



Recently, there has been considerable interest in integer-valued time series models and a sizeable 
volume of work is now available in specialized monographs (e.g., MacDonald and Zucchini [17], 
Cameron and Trivedi pT], and Steutel and van Harn [61]) and review papers (e.g., McKenzie 
[19], Jung and Tremayne [iQj, and WeiB [61]). Motivation to include discrete data models comes 
from the need to account for the discrete nature of certain data sets, often counts of events, 
objects or individuals. Examples of applications can be found in the analysis of time series of 
count data that are generated from stock transactions (Quoreshi [M]), where each transaction 
refers to a trade between a buyer and a seller in a volume of stocks for a given price, in optimal 
alarm systems to predict whether a count process will upcross a certain level and give an alarm 
whenever the upcrossing level is predicted (Monteiro, Pereira and Scotto [50]), international 
tourism demand (Brannas and Nordstrom [IS]), experimental biology (Zhou and Basawa [SH]), 
social science (McCabe and Martin [IS]), and queueing systems (Ahn, Gyemin and Jongwoo 

Several integer-valued time series models were proposed in the literature, we mention the 
INteger- valued AutoRegressive model of order p (INAR(p)) and the INteger- valued Moving 
Average model of order q (INMA(g)). The former was first introduced by McKenzie [H] and Al- 
Osh and Alzaid [3] for the case p = 1. The INAR(l) and INAR(]?) models have been investigated 
by several authors, see, e.g., Silva and Oliveira [SB], [SZ], Silva and Silva [SB], Ispany, Pap and 
van Zuijlen [37], [38], [39], Drost, van den Akker and Werker [28] (local asymptotic normality 
for INAR(p) models), Gyorfi, Ispany, Pap and Varga [31], Ispany [36], Drost, van den Akker and 
Werker [26], [27] (nearly unstable INAR(l) models and semiparametric INAR(p) models), Bu 
and McCabe [TH| (model selection) and Andersson and Karlis [7| (missing values). Empirical 
relevant extensions have been suggested by Brannas [13| (explanatory variables), Blundell [I^ 
(panel data), Brannas and Hellstrom [15] (extended dependence structure), and more recently 
by Silva, Silva, Pereira and Silva [59] (replicated data) and by WeiB [66] (combined INAR(p) 
models). Extensions and generalizations were proposed by Du and Li [30] and Latour [H]. The 
INMA(g) model was proposed by Al-Osh and Alzaid [i], and subsequently studied by Brannas 
and Hall [2] and WeiB [65j. Related models were introduced by Aly and Bouzar [5], [H], 
Zhu and Joe [70] and more recently by WeiB [65]. Extensions for random coefficients integer- 
valued autoregressive models have been proposed by Zheng, Basawa and Datta [67], [68] who 
investigated basic probabilistic and statistical properties of these models. Zheng and co-authors 
illustrated their performance in the analysis of epileptic seizure counts (e.g., Latour [H]) and 
in the analysis of the monthly number cases of poliomyelitis in the US for the period 1970-1983. 
Doukhan, Latour and Oraichi [25] introduced the class of non-negative integer-valued bilinear 
time series, some of their results concerning the existence of stationary solutions were extended 
by Drost, van den Akker and Werker [21]. Recently, the so called p-order Rounded INteger- 
valued AutoRegressive (RINAR(p)) time series model was introduced and studied by Kachour 
and Yao [12] and Kachour [H] . 

Moreover, topics of major current interest in time series modeling are to detect outliers in 
sample data and to investigate the impact of outliers on the estimation of conventional ARIMA 
models. Motivation comes from the need to assess for data quality and to the robustness of 
subsequent statistical analysis in the presence of discordant observations. Fox ^32j introduced 
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the notion of additive and innovational outliers and proposed the use of maximum hkehhood 
ratio test to detect them. Chang and Chen ^22] extended Fox's results to ARIMA models and 
proposed a likelihood ratio test and an iterative procedure for detecting outhers and estimating 
the model parameters. Some generalizations were obtained by Tsay |62] for the detection of 
level shifts and temporary changes. Random level shifts were studied by Chen and Tiao [23j. 
Extensions of Tsay's results can be found in Balke [9]. Abraham and Chuang [1] applied the 
EM algorithm to the estimation of outliers. Other useful references for outlier detection and 
estimation in time series models are Guttman and Tiao Bustos and Yohai [20], McCuUoch 
and Tsay [16], Pefia [52], Sanchez and Pefia [55], Perron and Rodriguez [53] and Burridge and 
Taylor [19]. 

It is worth mentioning that all references given in the previous paragraph deal with the case 
of continuous-valued processes. A general motivation for studying outliers for integer-valued 
time series can be the fact that it may often difficult to remove outliers in the integer-valued 
case, and hence an important and interesting problem, which has not yet been addressed, is 
to investigate the impact of outliers on the parameter estimation of series of counts which are 
represented through integer-valued autoregressive models. This paper aims at giving a con- 
tribution towards this direction. A more specialized motivation is the possibility of potential 
applications, for example in the field of statistical process control (a good description of this 
topic can be found in Montgomery [SH Chapter 4, Section 3.7]). In this paper we consider the 
problem of Conditional Least Squares (CLS) estimation of some parameters of the INAR(l) 
model contaminated with additive or innovational outliers starting from a general initial distri- 
bution (having finite second or third moments). We suppose that the time points of the outliers 
are known, but their sizes are unknown. Under the assumption that the second moment of the 
innovation distribution is finite, we prove that the CLS estimators of the means of the offspring 
and innovation distributions are strongly consistent, but the joint CLS estimator of the sizes of 
the outliers is not strongly consistent; nevertheless, it converges to a random limit with proba- 
bility 1. This random limit depends on the values of the process at the outliers' time points and 
on the values at the preceding time points and in case of additive outliers also on the values 
at the following time points. Under the assumption that the third moment of the innovation 
distribution is finite, we prove that the joint CLS estimator of the means of the offspring and 
innovation distributions is asymptotically normal with the same asymptotic variance as in the 
case when there are no outliers. Conditionally on the above described values of the process, 
the joint CLS estimator of the sizes of the outliers is also asymptotically normal. We calculate 
its asymptotic covariance matrix as well. In this paper we present results in the case of one 
or two additive or innovational outliers for INAR(l) models, the general case of finitely many 
additive or innovational outliers may be handled in a similar way, but we renounce to consider 
it. 

The rest of the paper is organized as follows. Section [2] provides a background description 
of basic theoretical results related with the asymptotic behavior of CLS estimator for the 
INAR(l) model. In Sections El and H] we consider INAR(l) models contaminated with one or 
two additive or innovational outliers, respectively. The cases of one outlier and two outliers are 
handled separately. Section |5] is an appendix containing the proofs of some auxiliary results. 
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2 The INAR(l) model 



2.1 The model and some preliminaries 

Let Z_|_ and N denote the set of non-negative integers and positive integers, respectively. 
Every random variable will be defined on a fixed probability space {Q,A, P). 

One way to obtain models for integer-valued data is replacing multiplication in the conven- 
tional ARMA models in order to ensure the integer discreteness of the process and to adopt 
the terms of self-decomposability and stability for integer-valued time series. 

2.1.1 Definition. Let {ek)keN be an independent and identically distributed (i.i.d.) sequence 
of non-negative integer-valued random variables. An INAR(l) time series model is a stochastic 
process {Xn)nez+ satisfying the recursive equation 

(2.1.1) Xk = J2 ^kj + Bk, fcGN, 

i=i 

where for all k E N, {C,k,j)jeN is a sequence of i.i.d. Bernoulli random variables with mean 
a e [0, 1] such that these sequences are mutually independent and independent of the sequence 
(q)^^^; and Xq is a non-negative integer-valued random variable independent of the sequences 
{ik,j)jm, ken, and {£i>)i>^^. 

2.1.1 Remark. The INAR(l) model in f l2.1.ip can be written in another way using the bino- 
mial thinning operator ao (due to Steutel and van Harn [60]) which we recall now. Let X 
be a non-negative integer-valued random variable. Let (^j)jeN be a sequence of i.i.d. Bernoulh 
random variables with mean aG[0, 1]. We assume that the sequence (^j)jeN is independent 
of X. The non-negative integer- valued random variable a o X is defined by 

^ ifx>o, 

ao X := \ j=i 

0, if X = 0. 



The sequence (Ci)ieN is called a counting sequence. The INAR(l) model in fl2.1.ip takes the 
form 

Xk = ao Xk-i + £fc, ke N. 

□ 

In the sequel we always assume that EXq < oo and that Ee\ < oo, P(£:i 7^ 0) > 0. Let 
us denote the mean and variance of Si by /i^ and cr^, respectively. Clearly, < /i^ < 00. 

It is easy to show that 

(2.1.2) lim EXfe = lim VarX^ = 'Il±^^ if « ^ (0, 1), 

and that limfc_i.oo EX^ = limfc_s>oo Var X^ = 00 if a = 1 (e.g., Ispany, Pap and van Zuijlen [371 
page 751]). The case a G (0, 1) is called stable or asymptotically stationary, whereas the case 
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a = 1 is called unstable. For the stable case, there exists a unique stationary distribution of 
the INAR(l) model in (12.1.11) . see Lemma [5. II in the Appendix. 

In the sequel we assume that a G (0, 1), and we denote by J^^ the cr-algebra generated 
by the random variables Xq, Xi, . . . , Xk- 



2.2 Estimation of the mean of the offspring distribution 

In this section we concentrate on the CLS estimation of the parameter a. Clearly, 
E(Xfc I J^^_i) = aXk-i + fJ-e, k E N, and thus 

n n 
k=l k=l 

For all neN, we define the function Qn : M"+^ x M -> R, as 

n 

Qn{xo,Xi, . . . ,Xn;a') := ^ (xfc -a'xk-i Xo,Xi, ... ,Xn,a' G M. 

k=l 

By definition, for all n G N, a CLS estimator for the parameter a G (0, 1) is a measurable 
function 5„ : ]R"+^ -> M such that 



on+l 



= inf Qn{xo, Xi,...,Xn] «') V (xo, a^i, . . . , x„) G 
It is well-known that 

(2.2.1) 5„(Xo, 

holds asymptotically as n — t- oo with probability one. Hereafter by the expression 'a property 
holds asymptotically as n — )■ oo with probability one' we mean that there exists an event 
S E A such that P(S') = 1 and for all u E S there exists an n{uj) G N such that the 
property in question holds for all n n{uj). The reason why ( 12.2. ip holds only asymptotically 
as 77, — )■ oo with probability one and not for all n G N and u E Q is that for all 
n G N, the probability that the denominator Y12=i -^k-i equals zero is positive (provided 
that P(Xo = 0) > and P(ei = 0) > 0), but P(lim„^oo ELi ^Li = oo) = 1 (which 
follows by the later formula (I2.2.6P ). In what follows we simply denote 5„(Xo, Xi, . . . , Xn) by 
an- Using the same arguments as in Hall and Heyde [35^ Section 6.3], one can easily check 
that 5„ is a strongly consistent estimator of a as n oo for all a G (0, 1), i.e., 

(2.2.2) P ( lim ^'='^n' -J";^^'-' =a)=l, V«g(0,1). 

\^n^oo l^k=lXk-l J 

Namely, if X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in (12.1.10 . then 

(2.2.3) EX 



1 — a' 



(2.2.4) EX^ = ^l±^ + 

1 — a (1 — a 



|2' 
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For the proofs of (]2.2.3p and f l2.2.4p . see the Appendix. By the existence of a unique stationary 
distribution, we obtain that {i G Z+ : i ^ Vin} with 

Vin := min |i G Z+ : P{ei = i) > o| 

is a positive recurrent class of the Markov chain {Xk)k&+ (see, e.g., Bhattacharya and Waymire 
Section II, Theorem 9.4 (c)] or Chung |2H Section 1.6, Theorem 4 and Section 1.7, Theorem 
2]). By ergodic theorems (see, e.g., Bhattacharya and Waymire [Til Section II, Theorem 9.4 
(d)] or Chung [211 Section 1.15, Theorem 2]), we get 

(2.2.5) P ( lim - VXfc = EX 1 = 1, 

\ k=l / 

(2.2.6) P( hm -J2XI = EXA=1, 

\ k=l / 

(2.2.7) Pf lim -VXfc_iXfc = E(X(aoX + £)) = aEX2 + /i,EX 1 =1, 

\ n^oo n ] 
\ k=l J 

where e is a random variable independent of X with the same distribution as e\. (For 
(I2.2.7p . one uses that the distribution of (X, a o X + e) is the unique stationary distribution 
of the Markov chain (X^, Xfe+Ofce^+O By ([M3D-(l22TD, 

p/. ^ «EX^ + /^,EX-/^,EX \ 

V hm an = — = a \ =1. 

\^n^oo EX2 J 

Furthermore, if EXq < oo and Ee^ < oo, then using the same arguments as in Hall and 
Heyde [351 Section 6.3], it follows easily that 

(2.2.8) ^/n{an - a) Af{0,al^^) as n oo, 
where — > denotes convergence in distribution and 



(2.2.9) a' := ^ ^ ^ 



with 



(2.2.10) 



:ex2)2 



EX-" = ^ , — + 3^ — ^ - 2- 

1 — a'^ 1 — 1 — a 



^ 3 /ie(^e+a/ie) ^ 



(l-a)(l-a2) (i-a)3 

For the proof of (12.2. lOp . see the Appendix. 

We remark that one uses in fact Corollary 3.1 in Hall and Heyde [53] to derive (I2.2.8p . It 
is important to point out that the moment conditions EXq < oo and Eel < ^ needed 
to check the conditions of this corollary (the so called conditional Lindeberg condition and an 
analogous condition on the conditional variance). 
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2.3 Estimation of the mean of the offspring and innovation distri- 
butions 



Now we consider the joint CLS estimation of a and /i^. For all n G N, we define the 
function Q„ : M"+i x ^ M, as 

n 

Qn{Xo, Xi,..., Xn, /U^) := ^ (xfc - a'Xk-1 - fJ'e) , Xo,Xi,..., Xn, /i'^ G M. 

k=l 

By definition, for all n G N, a CLS estimator for the parameter G (0, 1) x (0, oo) is a 

measurable function : M"^"^ — )■ such that 

Qni^XQ, Xi, ■ ■ ■ 5 Xfi, ttji(3^0) "^l) ■ ■ ■ ) -^n)? A''£,n('^0) "^l; ■ ■ • ; -^n)) 



It is well-known that 



inf ^ Qn{xo, Xi,...,Xn; a', /i'J V (xq, Xi, . . . , x„) G M'^^^ 



k-l — 0, 



k=l 

n 



k=l 



hold asymptotically as n — > oo with probability one, or equivalently 





















Y2=i ^k 



holds asymptotically as n — t- oo with probability one. Using that, by fl2.2.5p and fl2.2.6p . 

EX^- (EX)=^ = VarX > I = 1, 



P I lim 

n— 5>oo TL 



we get 



^ ELl Xk-lXk - (ELl Xk-l) {Y2=l ^k) 

(ELi^fc-i) iYlk=i^k) - (ELi^fc-i) iYjk=i^k-iXk) 



k-li 



1 / " " A 

\fc=l k=l J 



hold asymptotically as n — )• oo with probability one, see, e.g.. Hall and Heyde [35| 
formulae (6.36) and (6.37)]. In the sequel we simply denote a„(Xo, Xi, . . . , X„) and 
/i£,„(Xo,Xi, . . . ,X„) by (Xn and /ie,^, respectively. It is well-known that ( 
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a strongly consistent estimator of {a, fie) as n — > cxd for all {a, fie) G (0,1) x (0,oo), see, 
e.g.. Hall and Heyde [3S1 Section 6.3]. Moreover, if EXq < oo and Eef < oo, by Hall and 
Heyde ^ formula (6.44)], 



(2.3.1) 
where 

(2.3.2) 



^/n{an - a) 




'o 


5 Ba,e^ 












as n — )• oo. 



(2.3.3) 



EX2 EX 
EX 1 

1 

(VarX)2 



A„ . := a(l - a) 



-1 



A. 



EX' EX 
EX 1 



1 -EX 
-EX EX' 



A. 



1 -EX 
-EX EX' 



EX3 


EX2" 




'ex' 


ex' 












EX2 


EX 




EX 


1 



and X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in fl2.1.ip . For our later purposes, we sketch a proof of (12.3.11) . Using that 









-1 








ELi Xk-i n 




Yl=i Xk 



holds asymptotically as n — )• oo with probability one, we obtain 



a„ — a 



k=l^k-l 2^k=l^k-l 



a 



-1 



X]fc=l(-^fc - <yXk-l - fie)Xk~l 
ELi(^fc - aXk-l- fie) 



holds asymptotically as n — > oo with probability one. By f l2.2.5p and f l2.2.6p . we have 

as n — )■ oo with probability one. 



1 

n 



En -ia2 Y^n -t^ 

Y2=lXk-l 



1 




"EX2 


EX 


— )■ 






77, 




EX 


1 



and, by Hall and Heyde [35l Section 6.3, formula (6.43)] 

^ Yl=li.Xk - «Xfe„i - fie)Xk- 

-^YJl=i{Xk - aXk-i - fie) 
Using Slutsky's lemma, we get (12.3. ip . 



A 



as n — 7- oo. 
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Let us introduce some notations which will be used throughout the paper. For all k,£ G Z+, 

let 

[l if k = i, 
[O if k^i. 

For a sequence of random variables (CA;)A;eN and for si,...,siEN, / G N, we define 

^ n 

k=l k=l 

ky^si,...,kf^si 

3 The INAR(l) model with additive outhers 
3.1 The model 

In this section we only introduce INAR(l) models contaminated with additive outliers. 

3.1.1 Definition. A stochastic process {Yk)kez+ is called an INAR(l) model with finitely 
many additive outliers if 

I 

i=l 

where {Xk)k&+ is an INAR(l) process given by (12.1.11) with a G (0, 1), EXq < oo, Ee\ < oo, 
P(ei 7^ 0) > 0, and / G N, Sj, 6'j G N, i = 1, . . . , I such that Si ^ sj if i ^ j , i,j = l,..., I . 

Notice that 6'j, z = 1,...,/, represents the ith additive outlier's size and 6k,si is an 
impulse taking the value 1 if k = si and otherwise. Roughly speaking, an additive outlier 
can be interpreted as a measurement error at time Sj, 2 = 1,...,/, or as an impulse due to 
some unspecified exogenous source. Note also that Fq = -^o- Let J^^ be the a-algebra 
generated by the random variables Fq; ^i; • • • ; ^fc- For all n G N, ?/o; • • • ; Z/n ^ 1^ and G il, 
let us introduce the notations 

Y„(u;) := iYQ{uj),Yi{uj), . . .,Yn{uj)), Y„ := {Yq.Yi, . . . y„ := (?/o,yi, • • • 



3.2 One outlier, estimation of the mean of the offspring distribution 
and the outlier's size 



First we assume that 7 = 1 and that the relevant time point Si := s is known. We concentrate 
on the CLS estimation of the parameter (a, 9) with 6 := 6i. An easy calculation shows that 



E(Yfc I J'J. J = aXk-i + /i£ + Sk,sO = a{Yk-i - 6, 



fc-l,sC 



Sk.fO 



aYfc-1 + + i-aSk-i,s + Sk,s)0 = < 



aYk-i + He 
aYk-i + fie + d 
aYk-i + He - Old 

^oYk-i + He 



if A; = 1, . . . , 

if k = s, 

if k = s + 1, 

if A; ^ s + 2. 



s-1, 
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Hence 



(3.2.1) k=i k=i 

+ {Ys+i - aYs - fis + aOy. 

For all n ^ s + 1, n eN, we define the function Qn : R"+i X R2 ^ R, as 

n 

QniYn, a\ 9') := ^ ' {yk- - l^eY + {Vs - a'Vs-i - fJ-e - d'Y 

k=l 

By definition, for all n ^ s + 1, a CLS estimator for the parameter [a, 6) G (0, 1) x N is a 
measurable function (5„, 6n) : — such that 

an(yn),6'„(yn)) = inf QniYn] a' ,0') V y„ G S'n, 

(«',6»')e]R2 

where 5'„ is a suitable subset of R""*"^ (defined in the proof of Lemma rj.2.11) . We note that 
we do not define the CLS estimator (5„,^„) for all samples y„ G M"^^. We have for all 
(y„;a',e') eR"+^ xR2, 

n 

(y„;a',6'') = ' ^ ^ 2{yk - a'yk-i - fi^) {-Vk-i) + '^{ys - a'Vs-i - IJ-s - 0'){-ys-i) 

k=l 

+ 2 (y,+i - a'l/, - /X, + a' 9') {-ys + 
= Y^2{yk- a'yk-i - fie){-yk-i) - 2^'(-y._i) + 2a' 6' {-y, + 6') + 2(y,+i - a'y, - /x,)^', 



k=l 

and 



^%(yn; a', 6*') = -2{ys - a'ys-i - l^e - +2{ys+i - ays - l^e + a' 6') a'. 



89' 

The next lemma is about the existence and uniqueness of the CLS estimator of (a, 9). 
3.2.1 Lemma. There exist subsets Sn C R"'^"'^, s + 1 with the following properties: 

(i) there exists a unique CLS estimator (5„,6'„) : Sn — ?■ R^, 

(ii) for all y„ G Sn, (5„(y„), 6'„(y„)) is the unique solution of the system of equations 
(3.2.2) ^(y„; a\ 9') = 0, ^(y„; a', ^') = 0, 

(iii) Y„ G /ioWs asymptotically as n — )■ oo w^/i probability one. 
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Proof. For any fixed y„ G W^^^ and a' G M, the quadratic function M 9 i-)- QniYn', 6') 
can be written in the form 



where 



A„(a') := 1 + {a'f, 
t„(y„; a') := (1 + {a' f)ys - a'^y^-i + Vs+i) - (1 - 

A:=l 

We have Qniyn]o:') = i?„(y„; a')/y4„(Q:'), where R 9 a' i— i?„(y„;a') is a polynomial of 
order 4 with leading coefficient 



Cn(yn) := 

k=l 

Let 

5^n:={yneM"+i:c„(y„)>0}. 

For y„ G 5'„, we have lim|Q,/|_i.oo <5n(yri; a') = oo and the continuous function M 9 «' i— )■ 
Qn{yn', cfc') attains its infimum. Consequently, for all n ^ s + 1 there exists a CLS estimator 
{an, dn) : S'„ where 

Qn(yn;5„(yn)) = inf Q„(y„;a') Vy„ g 5^„, 

o'eM 

(3.2.3) 6'„(y„) = A„(5„(y„))"H„(y„;a„(y„)), y„ G S^„, 

and for all y„ G S^, (5„(y„), ^^„(y„)) is a solution of the system of equations fl3.2.2p . 

By (12X51) and fl2X6|) . we get P (^lim„^oo n-ic„(Y„) = EX^j = 1, where X denotes 
a random variable with the unique stationary distribution of the INAR(l) model in fl2.1.ip . 
Hence Y„ G Sn holds asymptotically as n — >■ oo with probability one. 

Now we turn to find sets Sn d Sn, n ^ s + 1 such that the system of equations (13.2.21) 
has a unique solution with respect to (a', 0') for all y„ G Sn- Let us introduce the (2 x 2) 
Hessian matrix 



Hn{yn;oi' ,0') :-- 



d{a'Y de'da' 



{yn,a',9') 



.da'de' d{e'f 

and let us denote by Ai^niyn', 0') its i-th order leading principal minor, i = 1,2. Further, 
for all n ^ s + 1, let 

Sn ■■= {yn e Sn : A,,„(y„; ^') > 0, ^ = 1,2, V {a', 6') G R^}. 

By Berkovitz |IOl Theorem 3.3, Chapter 111], the function 3 (^/^ ^ g„(y„;a',^') is 
strictly convex for all y„ G S^. Since it was already proved that the system of equations 
(13.2.21) has a solution for all y„ G Sn, we obtain that this solution is unique for all y„ G S^. 
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Next we check that Y„ G Sn holds asymptotically as n — t- oo with probability one. For 
all {a',e') e M^, 

' k=l \k=l 



and 



Q^0f,i^n,a',e') = 2{{a'y + l). 

Then 

//„(Y„;a',^') 

n. 

^^'^'^ Xl_, + {Xs + 9- e'f Xs^i + Xs+i - 2a' Xs - /i, - 2a' {6 - 6') 

k=l 

Xs-i + Xs+i - 2a' Xs -i^e- 2a' {e - 9') {a'f + 1 

has leading principal minors Ai_„(Y„; a' ,9') = 2 j ^^^^ ^ ^l-i + i^s + 9 — 9'Y\ and 

\ fc=i / 

A2,.(Y„; a', ^0 = det if^„(Y„; a', ^0 = 4((aO' + 1) |^ J^^'^'^ X^, + (X, + - 0')' j 

- a[Xs-i + X«+i - 2a'X, - /ie - 2a'(0 - ^O)'- 

By mm. 

P f hm -Ai,„(Y„;a',^^') = 2EX2, V {a', 9') e rA = 1, 

pf hm -A2,n(Y„;a',^') = 4((«')' + l)EX2, V {a' ,9') emA = 1, 

yn-s-oo 77- y 

where X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in f l2.1.ip . Hence 

P( lim Ai,„(Y„;a',^') = oo, V {a', 9') G M^) = 1, 

n—^oo 

P( lim A2,„(Y„;«',0') = oo, V {a', 9') G R^) = 1, 
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which yields that Y„ G Sn asymptotically as n — t- oo with probability one, since we have 
already proved that Y„ G Sn asymptotically as n — )■ oo with probability one. □ 

By Lemma [3.2. (5n(Y„), 6'„(Y„)) exists uniquely asymptotically as n — > oo with 
probability one. In the sequel we will simply denote it by (5„, 6'„). 

The next result shows that 5„ is a strongly consistent estimator of a, whereas 6n fails 
to be also a strongly consistent estimator of 6. 

3.2.1 Theorem. For the CLS estimators (5„,6'„)„eN of the parameter {a, 9) G (0,1) x M, 
the sequence (5„)„gN is strongly consistent for all (a, 6^) G (0, 1) x N, i.e., 

(3.2.4) P( lim 5„ = a) = 1, V (a, ^) G (0, 1) x N., 

whereas the sequence {9n)nm ™^ strongly consistent for any (a, 9) G (0, 1) x N, namely, 

1 ~^ 2 C^s-l + ^s+l) - — 5 



(3.2.5) P ( lim 9n = Y,- -^—^{Y^_^ + Y,+^) - -— ^/i. ) = 1, V («, 9) G (0, 1) x N. 



Proof. An easy calculation shows that 

^3 2 6) a ^TJLlO^k- ^^e)Yk-l-9niY,_l + Y,+l- 



^(n_i + y;+i)-Y^^ 

hold asymptotically as n — > oo with probability one. Since Y^ = Xk + Sk,s9, A; G Z+, we get 

n 



A;=l 



and 



^^'''^'\Xfc - fie)Xk-i + {X, + 9- /i,)X,_i + (X,+i - /i,)(X, 
fe=i 



^ Yl, - 29nYs + (^„)' = + + - 2^"(^^ + ^) + (^«)'' 



fc=i fc=i 
hold asymptotically as n — ?■ oo with probability one. Hence 

/g 2 8) 5 = Z]fc=l(-^fc ~ fIe)Xk-l + {9 - 9n){Xs-i + Xs+i - He) 

ELi ^ti + - {o-dn + 2X,) 

holds asymptotically as n — t- oo with probability one. We check that in proving fl3.2.4p it is 
enough to verify that 

(3.2.9) P ( lim (^-^») (-^^-1 + ^^+1-/^^/ = 

r. . , (9 -9n)(9 -9„ + 2Xs) 
3.2.10 P lim ^ ^ — ^ = 0=1. 
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Indeed, using (EZH]), (^:2M and fl2X7l) . we get (KTM and f l3.2.ini) yield that 

p/^,. ~ c.EX^ + /i,EX-/i,EX \ 

P lim a„ = = a \ =1. 

Now we turn to prove fl3.2.9p and (13 .2 .101) . By (13.2.71) and using again the decomposition 
Yk = Xk + 5a;,s^, k G we obtain 

On = Xs + 9 - 1 JXs-l + Xs+l) - fie, 

l + {an)^ l + (a„)2 

and hence 

(3.2.11) -e\^X, + + X,+i) + 

i.e., the sequences (6'„)„gN and (6'„ — 9)neN are bounded with probabihty one. This imphes 
(Km> and f nXTU]) . By flXT7|) and ([2231), we get flX^ . □ 

3.2.1 Remark. We check that E(hm„^oo^n) = 0, \/ {a, 9) G (0,1) x M, and 

(3.2.12) Var ( lim ?„) = + ' °' ' + j}' ^ + <^ ' °>'"' + 

^ n^oo ^ (1 + ) 

Note that, by (I3.2.5p . with probabihty one it holds that 

~ tt 1 — C( 

lim 9n = Xs + 9- — — (X,_i + Xs+i) - — ^/i. 

- aXs-i - fie- a{Xs+i - aXs -fie) ^ Ms - aMs+i 

^ ^ ^ T"^ — 2 ~ ^ ^ T"^ — 2 ' 

1 + 1 + a"' 

where M^. := - aXfc_i - ^u^, k e N. Notice that EM^ = 0, k eN, and Cov(Mfc, M^) = 
Sk^eVarMk, k,ien, where Var = ^^^(l - a'^-i) + a'^(l - a)EXo + a^, keN. Indeed, 
by the recursion EX^ = aEX^^i + fie, ^ G N, we get EMk = 0, A; G N, and we get 

1 -n^ 

(3.2.13) EX^ = a^EXo + (1 + a + ■ ■ ■ + a^-^)fie = a^EXo + /i„ ieN, 

1 — a 

and hence 

(^k-l 
(^fc,j - «) + (^fe - fie 
3=1 

(3.2.14) ^ _ ^k-i 

= a{l - a)EXfe_i + cr^ = a{l - a)fie— h a^{l - a)EXo + al 

1 — a 

= afieiX - ot"'^) + a'^il - a)EXQ + al, G N. 

Hence E(lim„^oo 9n) = 9 and 

Var ( lim ft„) = / fayu,(l - a'-^) + a%l - a)EXo + al 

+ a^(a/i£(l - a^) + a'+^(l - a)EXo + a 
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which imphes (I3.2.12p . 

We also check that On is an asymptotically unbiased estimator of 9 as n — )• oo for all 
(a, ^) G (0, 1) X M. By fl3.2.5p . the sequence 9n — 9, n eN, converges with probability one, 
and, by fl3.2.1ip . the dominated convergence theorem yields that 

lim E{9n - ^) = EMim {9^ - 9)] = 0. 

n— >-oo n— >c« 

Finally, we note that lim„^oo can be negative with positive probability, despite the fact 
that 9 eN. □ 

3.2.1 Definition. Let (Cn)neN; C ^'^'^ V random variables on {Q,A,P) such that rj 
is non-negative and integer-valued. By the expression "conditionally on the values r], the weak 
convergence — > C n — t- oo holds" we mean that for all non-negative integers m G N 
such that P(?7 = m) > 0, we have 

n— >-oo 

for all ?/ G M being continuity points of Fc^ \ {r,=m] , where | {r,=m} and Fc^ \ denote the 

conditional distribution function of Cn and ( with respect to the event {ri = m}, respectively. 

The asymptotic distribution of the CLS estimation is given in the next theorem. 

3.2.2 Theorem. Under the additional assumptions EXg < oo and Ee^ < oo, we have 

(3.2.15) -\/n(Sn — a) — ^ A/'(0, cr^ as n — )■ oo, 

where cr^ is defined in (12.2.9^ . Furthermore, conditionally on the values Yg-i and Yg+i, 

(3.2.16) \/n (9n - lim 9k) A AT (0, ) as n ^ oo, 

\ fc— >-oo / \ > / 



where 



Proof. By fl3.2.8p . we have ^/n{an ~ ot) = ^ holds asymptotically as n — cxd with 
probability one, where 

1 " 1 ~ 

An := V(Xfe - aXu-i - /i.)Xfc„i + ^{9 - 9n){Xs-i + X^+i - /ie - a{9 - 9n) - 2aX,), 

1 " 1 _ _ 

S„ := - Vx2„i + -(^ - 9n){9 -9n + 2X,). 



n — ' n 

k=l 



By ([223]), we have 



^ 'A/'(0,a^_J as n^oo. 
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By (I3XTTD, 



P I lim 



9n)iXs-i + X,+i -fxs- a{e - On) - 2aXs) = 0=1 



p lim -{e - e^){e - 0„ + 2X,) = 0=1. 

\ n-)-oo n 



Hence Slutsky's lemma yields (13.2. ISp . Using f l3.2.5p and that 

(5„ - a){Ys-i + + (5„ - a) He - + F^+i) - (1 - «)/^e 



(3.2.17) en = Y,+ 



1 + (a^ 



holds asymptotically as n ^ oo with probability one, we get 

a 



k-^oD / \ \ 1 + 



1 - a 
1 + 



+ 



(an - a)(y,-i + + (an - q)/^^ - ^(^5-1 + ^.+1) - (1 - 

1 + (5.)2 

1 — a 



-(^-1 + 1^. 



s+l) 



1 + (a. 



+ a(n_i + n+i) 



(l + (5„)2)(l + a2) 



(1 — a)(a + 



(l + (5„)2)(l + «2)_ 

Using fl3.2.15|) and (IX^ . Slutsky's lemma yields (13.2. 16|) with 



2 _ 2 



-Ys-1 — Ys+l + /^e 



(l + a2)2 yi + a 



1 + ^2 



+ 



2a' 



(l + «2): 



:(n_i + n+i) + 



2a(l - a) 
(l + a2)2 



1 + 2a - 



1 + a"' 



□ 



3.3 One outlier, estimation of the mean of the offspring and inno- 
vation distributions and the outher's size 

We assume 1 = 1 and that the relevant time point s G N is known. We concentrate on the 
CLS estimation of a, fi^ and 6 := 61. For all n ^ s + 1, n G N, we define the function 

Qn : M"+^ X R3 ^ M, as 

n 

Qniyn, a', /^e, 0') := ^ ' {vk- a'Vk-i - /iQ^ + [Vs - a'Vs-i - l^'e - d'Y 

k=l 

+ {vs+i - a'y, -fi', + a'df, y„ G R^+\ a', 9' G M. 
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By definition, for all n ^ a CLS estimator for the parameter (a, /i^, 9) G (0, 1) x (0, oo) xN 

is a measurable function (q?„, /ig „, 6'„) : S'„ — )■ M'^ such that 

(yn))/^e,n(yn),6'n(yn)) = inf Qniyn'-,Oi',lj',9') V y„ G S'„, 

(a',/x^,6»')eIR3 

where Sn is suitable subset of R""*"^ (defined in the proof of Lemma [3.3. ip . We note that 
we do not define the CLS estimator (a^, /^e.n, for all samples y„ G M""*"^. We get for all 
(y,;a',/x;,^0 eM"+^ xM3^ 

dQr 



da' 



-(y„;a',/i^,6'') 

k=l 

+ 2(|/s+i - a' Us - /u'g + a'6'') (-y^ + 6*') 

\k=i ) \k=\ / 

- 2 2^ 2/fe-i2/A: - 2(?/s - 6'')y,_i - 2?/^+i(?/^ - &) 

k=l 

n 

= Y'^{yk- a'Vk-i - n'^){-yk-i) - 2e'{-ys-i) + 2a'e'{-ys + 6') + 2(?/^+i - a'ys - fi'^)9', 

k=l 

-^(y„;a,/i^,^) 



n 



k=l 



= 2a' [J2yk-i-d'] +2nfx'^-2j2yk + 2e', 

and 



,fe=l / k=l 



^^(y„;a',/i^,6l') = -2(y^ - - /i^ - 6*') +2{ys+i - a'ys - jJ^'e + a'e')a. 

The next lemma is about the existence and uniqueness of the CLS estimator of {a,^i;,6). 
3.3.1 Lemma. There exist subsets Sn C M"^^, n ^ max(3, with the following properties: 

(i) there exists a unique CLS estimator 6'„) : Sn — t- M'^, 

(ii) for all y„ G Sn, (an(y„), /i£,n(yn), ^n(yn)) «s i/ie unique solution of the system of 
equations 

(3.3.1) ^^(y„; a',/i^,6'') = 0, ^^(y„; a', /x^, 6*') = 0, ^^(y„; a', /x^, 6^') = 0, 
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(iii) Y„ e Sn holds asymptotically as n ^ oo with probability one. 



Proof. For any fixed y„ e ]R"+-'^, n ^ max(3,s + 1) and a' e R, the quadratic function 
IR^ 3 {jj!^, 9') i-> QniYni oc' , jj!^, 9') can be written in the form 



Oi',^'e,9') 



9' 



T / 














9' 



- An{a') tn(yn;a') +Qn(yn;a')> 



where 



^n(yn;a') := 



ELi(yfe-«Wi) 

(1 + {a'Y)ys - a\ys-i + y.+i) 



k=l 



and the matrix 



Ania') 



n 1 — a' 
I -a' 1 + («')' 



is strictly positive definite for all n ^ 3 and a' e R. Indeed, the leading principal minors of 
An{a') take the following forms: n, 

:= n(l + (a')') - (1 - = - + 2a' + n - 1, 

and for all n ^ 3, the discriminant 4 — 4(n — 1)^ of the equation (n — + 2x + n — 1 = 
is negative. 

The inverse matrix A„(q;')'~^ takes the form 

1 + {a' f -(1 - a') 
-(!-«') n 



The polynomial IR 9 a' i-> Dn{oi') is of order 2 with leading coefficient n — 1. We have 
QniYn'-i oi') — RniYn'-i Oi')/Dn{a'), whcrc R 9 cc' i-> RniYn'-i Oi') is a polynomial of order 4 with 
leading coefficient 



k=l 



,fe=l 



,fe=l 



Let 



Sn := {yn e R"+' : c„(y„) > O} . 
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For y„ G Sn, we have lim\a'\-^ooQniyn]Ci') = oo and the continuous function M 9 a' h- 
Qniyn'jCi') attains its infimum. Consequently, for all n ^ max(3, s + 1) there exists a CLS 
estimator (5?^, 6'„) : Sn — M^, where 

Qn(yn;an(yn)) = mf Qn(yn; «') Vy„ G S^n, 



(3.3.2) 



^n(«n(yn)) (yn; ««. (y^) ) , 



y„, G S„ 



and for all y„ G S'„, (an(yn)) Aie,n(yn), 6'„(y„)) is a solution of the system of equations fl3.3.ip . 

By (I2X5|) and (E^J]), we get P (^hm„_^oo ^"^c„(Y„) = Varxj = 1, where X denotes 
a random variable with the unique stationary distribution of the INAR(l) model in (I2.1.ip . 
Hence Y„ G Sn holds asymptotically as n — )■ oo with probability one. 

Now we turn to find sets Sn C Sn, n ^ max(3, s + 1) such that the system of equations 
(13.3.11) has a unique solution with respect to (a', /x^, 9') for all y„ G Sn- Let us introduce the 
(3 X 3) Hessian matrix 



Hn{yn;a,IJ''e,0') : 



r d^Qn 








dfj.'^ da' 


de'da' 














d^Qn 






_ da'dd' 







(y„;a',/i;,^') 



and let us denote by Aj „(y„; a', /i^, 6*') its i-th order leading principal minor, i = 1,2,3. 
Further, for all n ^ max(3, s + 1), let 



Sn ■= |yn e Sn : Ai,„(y„; a', /i^, 6^') > 0, i = 1, 2, 3, V {a, /i'^, 6*') G 1 

By Berkovitz [TOl Theorem 3.3, Chapter HI], the function 3 (a',/^;,^') Q„(y„; a', /x^, 
is strictly convex for all y„ G S^. Since it was already proved that the system of equations 
(13.3.11) has a solution for all y„ G Sn, we obtain that this solution is unique for all y„ G S^. 

Next we check that Y„ G holds asymptotically as n — )■ cxd with probability one. Using 
also the proof of Lemma 13.2.11 for all (a', fx'^, 6') G M'^, we get 



d{a 



fe=i 



7ii7(Yn;«',/.;,^') 



^^(Y„; a', /x^, e') = 2(n_i + F.+i - 2a% - /x^ + 2a'^') 



2(X,_i + - 2a% - /x; - 2a' {6 - 6')), 
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and 



^^(Y- ^^'e. 0') = |^(Yn; = 2 n-1 - 2^' = 2 ( 5^ X, 



k-l 



9-9' 



k=l 



vfc=l 



Then 



5^(Y„;a',/i'„0') = 2((a')' + l) 



^(Y„;a',/i;,0') = 2n. 



Hn{Yn;a',iJ,'^,9') 



k=l 



Y2=i^k-i + 9-9' 
a 



n 

1-a' 



1 - a' 
fa')' + 1 



where a := + X^+i - 2a' - fi', - 2a'{9 - 9'). Then if„(Y„; a', /x^, has leading 
principal minors Ai,„(Y„; a', /i^, := 2 ^ ^^^^^ + (X, + ^ - 0')' j , 



fc=i 



and 



A3,„(Y„; a', /x',, = det ff„(Y„; /i^, 



n 



[{{o.r + l){i^^'^''xU + (X. + 9-9'f^ 
{{a'f + 1) Xk-i + 9-9'] + 2(1 - a')a ( ^ X^.i + ^ - ^' 



n 



.fc=l 



fc=i 



By flT^ and fl^XBjl . we have 



1 



P lim — Ai,„,(Y„;a',/i;,0') = EX^ V G = 1 



P lim — A2,„(Y„;a',/i;,eO = VarX, V {a',fi'„9') G MM = 1, 
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and 



P lim —A3,n{Yn,a',fi',,e') = ((a')' + 1) VarX, V {a',fi',,e') G = 1, 
yn-5-oo gn^ J 

for all {a',fi'^,d') G M^, where X denotes a random variable with the unique stationary 
distribution of the INAR(l) model in f l2.1.ip . Hence 

P( lim A,,„(Y„;a',/i;,^') = 00, V (a', /i^, 0') ^ M^) = 1, ^ = 1,2,3, 

n—^oo 

which yields that Y„ G Sn asymptotically as n 00 with probability one, since we have 
already proved that Y„ G Sn asymptotically as n — t- 00 with probability one. □ 

By Lemma [3.3. (a„(Y„), /i£^„(Y„), 6'„(Y„)) exists uniquely asymptotically as n — )■ 00 
with probability one. In the sequel we will simply denote it by {an,^e,n,On)- 

The next result shows that a„ and are strongly consistent estimators of a and /le, 
respectively, whereas 6n fails to be a strongly consistent estimator of 6. 

3.3.1 Theorem. For the CLS estimators {an,Jie,n,On)nm of the parameter {a^HeiO) G 
(0, 1) X (0, 00) X N, the sequences {an)nm and {pe,n)nm o,re strongly consistent for all 
(a,/ie,6') G (0,1) X (0, cx)) X N, i.e., 



(3.3.3) 
(3.3.4) 



P( lim a„ = a) = 1, V (a, /i^, d) G (0, 1) x (0, 00) x N, 

n— ^00 

P( lim = f^e) = 1, V {a, fis, 0) G (0, 1) x (0, 00) x N, 



whereas the sequence {6n)n&% is not strongly consistent for any (a, /Xg, 9) G (0, 1) x (0, 00) x N, 
namely, 



(3.3.5) 



P I lim 9n = Ys- 

, n-s>oo 1 -\- a 



l + a 



2f^e I = 1. 



for all (a, /x^, 6) G (0, 1) x (0, 00) x N. 
Proof. An easy calculation shows that 



k=l 



fe=l 



.fc=l 

or equivalently 



(3.3.6) 



Y2=i Yk-i - On n 
Ylk=i Yk-iYk — dn{Ys_i + Kj+i) 









f^e,n 
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holds asymptotically as n — )■ oo with probability one. Let us introduce the notation 



,k=l 
n 



n 



n 

^Xfc.i + 9 — On 



n ^ s + 1, n G N. 



fc=i 



By fl2:23|) and fl2X6|l . 

(3.3.7) P ( lim = - {£Xf = VarX > ) = 1, 

which yields that P(lim„_!.oo En = oo) = 1. Hence asymptotically as n — t- oo with probability 
one we get 

^ - ELl ^k-l + On 





1 







X 



ELl - On 



(3.3.8) 



~ J2k=l ^k-l + (On — 0) 

ELiXl^ + ix^ + e-Onf-x^ 



X 



Yl'k=l-^k-lXk + {6 — 6n){Xs-l + Xs+l] 
Yl=l ^k - (On - d) 



1 

En 



(2) 



where 



fc=i 



A:=l 



K^'^ ^^-^^^ -\^Xu-i][Y,Xk]+n{9- ^„) (X,_i + X,+i) + (^„ - 0) ^ X^. 

n 



+ 



'n ^ ) 1 



k=l 



and 



fc=i 



n n 

^-^fc-i-^fc — {On — oy{Xs-i + x^+i) — {6n — 6) 'y^^xi_^ 

k=l k=l 

n n 
+ ( X, + e - ^„ ) 2 ^ Xfc - ( ^„ - e ) ( X, + ^ - ^„ ) 2 _ ^ 2 ^ ^ ^ 2 



+ 



k=l 



k=l 
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Similarly, an easy calculation shows that 

n n 



fe=l 



fc=l 



(1 - an)%,n + (1 + {Oinf)0n = (1 + (an)')^ " Snl^-l + ^+0, 



or equivalently 



n 1 — an 



holds asymptotically as n — )■ oo with probability one. Recalling that = n(l + (a„)^) ■ 

(1 — Sn)^, we have asymptotically as n — >■ oo with probability one, 





1 







1 + -(1 - an) 

-(1 - an) n 



(1 + {an)')Ys - a„(y,_i + n+i) 



(i+(an)^)(Efc^in-s»Efc=iyfc-i)-(i-s„)((i+(a„)^)y.-s„(Y.-i+n+i)) 

-Dn(S„) 

-(l-Sn)(Efc=in-SnEfc=iyfc-l)+"((l+(Sn)^)y.-Sn(n-l+n+l)) 



We show that the sequence — 9)nen is bounded with probabihty one. Using the 



k e Z+, 


we 


get 








1 


rn 


9n — 




-D„(S„) 


T^(4) 



(3.3.9) 



holds asymptotically as n — >■ oo with probability one, where 



and 



yj^) (1 + {an)') "-E^^-i + (1 - «")^ 

\fc=i fc=i y 

- (1 - an) ((1 + (Sn)')^. - ani^s-l + ^.+l) + (1 + (S„)')^) 

- n{l + {anf)lJie + (1 - an)^A«£ 

(n n 
k=l k=l 

- (1 - an) ^(1 + - an{Xs_i + X^+i) - (1 - , 
:= -(1 - S,) K^Xfe - a„;XXfc_i + n((l + - + 



.fc=i 



k=l 
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By (]3.3.9p . we have asymptotically as n — t- oo with probability one 

(1 + (anY)n 



\9„. -9\^ 



[1 + (a„)^)n - (l-Sr. 



1+ a. 



n 



\OLr. 



(l-5n)2 

n(l+(Q„)2) 

1 



1 + {an? 



1 + an 



s+1 



n 



1 - 



(l-5„)2 



n(l+(S„)2) 

Using fl2X5D and that 



2 n ^2 



s+1 



n 



'I - OLr. 



+ X<j + Xs_i + X, 



< 3, n e N, 



1 + (an)2 

we have the sequences (6'„ — &)n(^n and (^^n)neN are bounded with probability one. 
Similarly to f l3.2.7p . one can check that 

1 - Sr,. ^ 



(3.3.10) 



1 + (a^ 



1 + [an 



holds asymptotically as n — > oo with probability one. 

Using f l3.3.7p and f l3.3.8p . to prove f l3.3.3p and fl3.3.4p . it is enough to check that 



P lim 



(1) 



aVarX = 1 and P lim 



(2) 



/ie Var X 



for all (a, /i^, &) G (0, 1) x (0, oo) x N. Using that the sequence [d^ — Q)nm is bounded with 
probability one, by (12.2.51) . (I2.2.6P and fl2.2.7p . we get with probability one 



lim 



yiX) 



lim 



(2) 



aEX2 + /i,EX- (EX)2 = a Var X + /x,EX + (a - 1)(EX)2 = aVarX, 



EX^EX - EX(aEX2 + /x,EX) = /x, Var X + ((1 - a) EX - fie)EX^ = /x, VarX, 



71— >oo Tl 

where the last equality follows by fl2.2.3p . 

Finally, fl333|) follows from fl3.3.10p . (K3^ and I^J^. 

The asymptotic distribution of the CLS estimation is given in the next theorem. 
3.3.2 Theorem. Under the additional assumptions EXq < oo and Eef < oo, we have 



□ 



(3.3.11) 



^/n{an - a) 



Af 



1 -Ba,e 



as n ^ oo, 
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where the (2 x 2) -matrix Ba,e is defined in (I2.3.2p . Moreover, conditionally on the values 
Ys-i and Y^+i, 



(3.3.12) 

where 



y/n[6n- lim 6k 

fc— >oo 



1 



Proof. By f l3.3.6p . with the notation 
we get 



(0,dJ, ,,Ba,eda,e) OS n — )■ OO, 

- + + (2a + 1 - a^)^^ 

-(l + a2)(i_a) 



n G N, 



B-' 



holds asymptotically as n — )■ oo with probability one. Hence 



q;„ — a 



B. 



-1 



Y:k=iYk-iYk -UYs-, + Ys+l) 

Y2=l ^k - On 



Then 



(5)- 



(6) 



holds asymptotically as n — )■ oo with probability one, where 

n 



fe=i 



V:i6) := 5^(n - aYk-i - fie) - (1 - a) 



fc=i 



To prove (13.3.111) . it is enough to show that 

Bn 



(3.3.13) 
(3.3.14) 



P I lim 

n— >-oo n 



EX2 EX 
EX 1 



A 

1 ^a,e 



as n — )• oo, 
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where X is a random variable having the unique stationary distribution of the INAR(l) model 
in d^XT]) and the (2 x 2)-matrix A^^, is defined in ([M3D. Using f lTT5]) . (EBj) and that 
the sequence {6n)n&i is bounded with probability one, we get ( I3.3.13p . Now we turn to prove 
(I3.3.14p . An easy calculation shows that 

n 

fc=i 

+ (X,+i - aX, - /X, - ae){X, + 9)- ^„(X,_i + X,+i) + 2a(X, + 9% - a{9nf + //A 

n 

= J](Xfc - aXfc_i - ;U,)X,_i + ^(X,_i + X,+i) - 2a9X, - a9^ - 9fi, 

k=l 

- UXs^i + X,+i) + 2a(X, + 9)9n - a{9nf + /i.^n 

n 

= ^(Xfc - aXk-i - fie)Xk-i + {9- 9n){Xs-i + X,+i - 2aX, - /i, - a{9 - 9^)), 

k=l 

and 

n 

V^^^ = ^(Xfc - aXfc_i - + (1 - - 
fc=i 

By formula (6.43) in Hall and Heyde [35, Section 6.3], 

! ^a,e^ as n — )• oo. 

Using that the sequence (6'„ — 9)neN is bounded with probability one, by Slutsky's lemma, we 
get (EXH- 

Now we turn to prove fl3.3.12p . Using f l3.3.5p and fl3.3.10p . we have 
^(9r, - lim 9k) = ^(9^- (y, - + - 

^ / (a„ - a){aan -1)^^ 

/- [ {aan-l){Ys-i + Ys+i) + {an + a + l - aan)%,nf^ . I- a \ 

= — [an -a)- — -[^le,n - M 

V [l + a^){l + [anY) l + a^ J 

holds asymptotically as — )■ 00 with probability one. Hence 

^/n(9n - lim 9k) 

k—^oo 

_ jaan - l)(ys-i + Ys+i) + (an + a + l- aan)%,n 1 - a 



fc-i 



A/" 
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holds asymptotically as n — t- oo with probability one. Using Slutsky's lemma, by f l3.3.3p . 
and f lCTT]) . we have (IXXT^ . □ 



It can be checked that the asymptotic variances of ^Jn ( 6*^ — limfc_^oo ) and 
i/rz \Qn— limfc_i.oo ^fc ) are not equal. 



3.4 Two not neighbouring outliers, estimation of the mean of the 
offspring distribution and the outhers' sizes 

In this section we assume that 1 = 2 and that the relevant time points Si, S2 G N are known. 
We concentrate on the CLS estimation of a, 9i and 62. Since = + 5fc,si^i + Sk,s2^2, 
k G Z+, we get for all Si, S2 G N, 



(3.4.1) 



OiiXk-l — Sk-l,siOl — 5k-l,s2(^2) + /^e + 5k,si0l + Sk,s2(^2 

oYk-i + /i£ + (-«4-i,si + 5k,s^)0i + (-«5fc-i,s2 + 4,52)^2, A; G N. 



In the sequel we also suppose that Si < S2 — 1, i.e., the time points Si and S2 are not 
neighbouring. Then, by (13.4.11) . 



E(n I fU) = { 



aYk-i + fie 
aVk-i + /ie + 6*1 
aYk-i + fie - aOi 
aYk-i + fie 

aYk-i + fie - a02 
^aYk-i + fie 



if 

if k = si, 

if k = Si + 1, 

if si + 2 ^ A; ^ S2 - 1, 

if A; = S2, 

if = S2 + 1, 

if A; ^ S2 + 2. 



Hence for all n ^ S2 + 1, n G N, 

n 

5^(n-E(n|jTi))' = 

fc=i 

(3.4.2) 



^ {Yk - aYk-i - fieY 



k=l 

fc^{si,Sl + l,S2,S2 + l} 



+ (y^i - - /i£ - 6'i)^ + (F^i+i - aYs^ - fie + otOiY 

+ (1^52 - OtYs2-l - fie-02f' + {Ys^+i - <^Ys2 - fie + a92f' ■ 



For all n ^ S2 + 1, n G N, we define the function Ql^ : R"+^ x — )■ 

Qi{yn;a',e[,e'2) 

n 

■= X] {Vk - a'Vk-l - fie) + (z/si - - /Ue - 6*'!) 

fc=l 

fc^{si,Sl + l,S2,S2 + l} 



as 



si + l - - /Ue + + (?/s2 - «'Z/S2-1 - fie-02)'^ + {ys2 + l - «'l/s2 - /Ue + a'6'2)' 
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for all y„ G ]R"+\ a' .O^.O'^ G M. By definition, for all n ^ S2 + 1, a CLS estimator for the 
parameter (a, 6*1, 6*2) G (0,1) x is a measurable function (5^, ^1 ^2 „) : S'„ — )■ M'^ such 
that 

Qiiyn, 5i(y„), ^/,„(y„), ^iJy-)) = , , >f Qt (y„; a', e[, 9',) V y„ G 

where Sn is suitable subset of M"+^ (defined in the proof of Lemma [3.4.11) . We note that we 
do not define the CLS estimator (5^, 6'/„, 6'J„) for all samples y„ G M"+^ For all y„ G R""*"^ 
and (a', ^1,^2) ^ M^, 



da 



A;=l 

fc^{si,Sl + l,S2,S2 + l} 

+ 2(l/si+i - a'y^i - /ie + a'6''i)(-?/5, + 61^) - 2[ys^ - a'y s^-i - - 6'2)?/,2-i 
+ 2(i/s2+i - - /ie + 062) {-ys2 + ^2), 

and 

^(y„; a', ^i, = -2{y,, - a'y,,^i - /i, - ^i) + 2a'{y,,+i - a'y,, - /i, + a'9[), 
-^(y„; a', 61^, 6*2) = -2(y^2 - a'y^a-i - A^e - ^2) + 2a'(?/s2+i - ay^^ - fJ-s + a'^'a)- 

The next lemma is about the existence and uniqueness of the CLS estimator of [0,61,62). 
3.4.1 Lemma. There exist subsets Sn C W^^^, n ^ S2 + I with the following properties: 

(i) there exists a unique CLS estimator (5^, 6*/^, 6*2 : Sn R^, 

(ii) for all y„ G Sn, (^^^(yn), ^i,n(yn)5 ^2,n(yn)) the unique solution of the system of 
equations 



^J^{yn,a',6[,6'2) = 0, 
(3.4.3) ^{yn,a',6[,6'2)=0, 

^{y^-a',6[,6'2)=Q, 
(iii) Y„ G Sn holds asymptotically as n 00 with probability one. 
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Proof. For any fixed yn G M"^"*^ and a' G M, the quadratic function 
Qnijn] ^'i, ^2) be written in tlie form 



3 K,^^2) ^ 



^'1 



ni j) 



where 



in(yn;a') 



(1 + {a'f)ys^ - a'{ys^^i + Vs^+i) - (1 - 
(1 + {a'f)ys2 - a'{ys2-i + - (1 - 



k=l 



1 + (a')' 
1 + («')' 



Then Qi{yn;a') = i?„(y„; a')/^n(«')> where D„,(a') := {l + {a'YY and M 9 a' ^ i?n(yn;a') 
is a polynomial of order 6 with leading coefficient 



Cn(yn) := - {y\+y. 



k=l 



Let 



Si := {yn G 



nn+l 



: C, 



.(yn) > 0} . 



For y„ G 5*^, we have \im\a'\-^ooQniyn',C(') = 00 and the continuous function M 9 a' i-t- 
QliYn', «') attains its infimum. Consequently, for all n ^ S2 + I there exists a CLS estimator 
{alel^,elJ:S^^^\ where 

(y n ; 5^, (y „ ) ) = inf (y „, ; a' ) V y „ G , 



(3.4.4) 



'^iV(y. 

^2!n(y. 



An{al{yn)) ^4(yn;an(yn)), 



yn G 



and for all y„ G S.^, (Q;^(y„), 6'/„(y„), 6*1 „(y„)) is a solution of the system of equations fl3.4.3p . 



By (E^ and (EBj) . we get P (^lim^^oo n-^c„(Y„) = EX^j = 1, where X denotes 
a random variable with the unique stationary distribution of the INAR(l) model in fl2.1.ip . 
Hence Y„ G S,^ holds asymptotically as n — t- 00 with probability one. 

Now we turn to find sets Sn C S^, n ^ S2 + I such that the system of equations (13.4.31) 
has a unique solution with respect to (a', 6[, 6^2) for all y„ G Sn- Let us introduce the (3 x 3) 
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Hessian matrix 



Hn{yn', a', 6[, 62) : 



d^Qi d^Qi d^Ql 



d(a'Y d9[da' dO'^da' 

a^Qi d^Ql d^Ql 

da'de[ d(e[)^ de'^de[ 

d^Qi d-^Qi d-^Qi 



2)1 



and let us denote by Aj^„(y„; a', 6*'^^, 6^2) its i-th. order leading principal minor, i = 1,2,3. 
Further, for all n G N, let 

Sn := {y„ e : A,,„(y„; a', e[, 9'^) > 0, ^ = 1, 2, 3, V (a', 9'^) eM?]. 

By Berkovitz ^ Theorem 3.3, Chapter III], the function 3 (a', e[, 9'^) ^ Qj,(y„; a', 9[, 9'^) 
is strictly convex for all y„ G Sn- Since it was already proved that the system of equations 
(13.4.31) has a solution for all y„ G 5*^, we obtain that this solution is unique for all y„ G Sn- 

Next we check that Y„ G Sn holds asymptotically as n — t- 00 with probability one. For 
all {a',9[,9'^) G M^, 



E 



if-i + 2n=,_i + 2(y„ - g^f + 2Yl_, + 2(F„ - 0: 



fc=l 

fc^{si,Si + l,S2,S2 + l} 



2 ^ + 2(X,, + 01 - 9\f + 2(X,, +02-^2 



2 

21 5 



A:=l 
fc^{si + l,S2+l} 



^|^(Y„; a', = 2(n,_i + F.^+i - 2^%, - /x, + 2a'e;) 



2(X,,_i + X,,+i - 2a%, - /i, - 2a'(^i - 9\)), 



^(Y„; a', 9[, 9'^) = ^^(Y„; a', 9[, 9',) = 2{Y,,_^ + - 2a%, - /i, + 2«'^^) 



d9'M 



2(X,,_i + X,,+i - 2«'X,, - /i, - 2a'(^^2 - ^;)), 



and 



52gt 



^(Y„;a',^;,^^) = 2((a')' + 1), 
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Then Hn{Yn] a', ^i, ^2) has the following leading principal minors 
Ai,„(Y„;«',^;,^^) = 



2X^1 + 2{X,, + 61- e[f + 2{Xs, +02-6', 
( „ 



2 

2; 5 



fc=i 

fc^{si+l,S2 + l} 



A2,„(Y„;«',^;,^^) = 4 ((«')' + !) 



5^ + (X,, + ^1 - + (X,, + ^2 - ^^2! 



U'^{si + l,S2 + l} 



and 



A3,„(Y„; a', ^1, 0^) = det i7„(Y„; a', ^i, Q'^ 
( 

8i((«r+ir 



^ xti + (X,, + ^1 - + (X,, + ^2 - 

\/i;^{si+l,S2+l} 

- ((a')' + 1) (^.1-1 + ^.1+1 - 2aX, - /i. - 2a'(^i - ^i))^ 



By (EXl, 



P lim -Ai,„(Y„;a',^;,e^) 

\n-s>oo n 



P( hm -A2,.(Y„;a',e;,e^; 

\n-5>oo n 



2EX2, V (a',^l,^^)G 



4((a')' + l)EX^ V (a',^;,^^) G™=^ 



and 



P { lim -A3,.(Y„; a', 9',) = 8((a')' + 1)'EX2, V (a', 0^, ^^^) G M=^) = 1, 

where X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in f l2.1.ip . Hence 

P( lim A,,„(Y„; a', Q'^, 9'^) = 00, V (a', 6',) G M=^) = 1, i = 1, 2, 3, 

which yields that Y„ G asymptotically as n — )■ 00 with probability one, since we have 
already proved that Y„ G 5*^^ asymptotically as n — )■ 00 with probability one. □ 

By Lemma 13.4. ![ (5^(Y„), ^^/„(Y„), 6'j„(Y„)) exists uniquely asymptotically as n — )• 00 
with probability one. In the sequel we will simply denote it by (5^, 9^^, 9^^). 
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An easy calculation shows that 
(3.4.5) 5 



(3.4.6) el^ = Y,, ^^i-^(r 1 + F ,) - /i„ 

(3.4.7) = - -^irr(n.-i + n.+i) - 

1 + (a„)^ 1 + (aA)^ 

hold asymptotically as ri — ?■ oo with probability one. 

The next result shows that 5^ is a strongly consistent estimator of a, whereas and 
62 n fail to be strongly consistent estimators of 61 and 62, respectively. 

3.4.1 Theorem. For the CLS estimators {a\,6l^,92n)n&] of the parameter {0,61,62) G 
(0,1) X N^, the sequence {aDn^n is strongly consistent for all {0,61,62) G (0,1) x N^, 
i.e., 



(3.4.8) P( lim 5^ = a) = 1, V (a, ^1, ^2) e (0, 1) x N 



whereas the sequences (6'i„)neN and {62n)nm are not strongly consistent for any {0,61,62) G 
(0, 1) X M^, namely, 



(3.4.9) 



P ( hm 6l = - -^(n,_i + - = 1 



a 1 — a; 

ri-s>oo ' 1 + a"^ 1 + 

/or a// (0,^1,^2) G (0,1) x N^. 
Proof. Similarly to (13. 2. lip , we obtain 

(3.4.11) \dl, - 6,\ ^ X,, + ^(X,,_i +X,,+i) + ^/i,, 

(3.4.12) \6l^ -62\<X.,^ + i(X,,_i + X,,+i) + 

which yield that the sequences (6'/„ — 6'i)„gN and (6^2 „ — 6'2)neN are bounded with probability 
one. Using fl3.4.5p . (13.4. lip and (I3.4.12p . by the same arguments as in the proof of Theorem 
l3Xn one can derive ([3311). Then f l3X8|) . f l3X6|) and fl3X71) yield f l3X9|) and fl3.4.10p . □ 

The asymptotic distribution of the CLS estimation is given in the next theorem. 
3.4.2 Theorem. Under the additional assumptions EXq < 00 and Eef < 00, we have 

(3.4.13) y/^{al-a) ^Af{0,crl^) as 00, 
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where a^, ^ is defined in f l2.2.9p . Moreover, conditionally on the values Ys-^-i, Ys^-i and 

(3.4.14) [^/^(^lVli--oo^Uj 
where 



e (T^ 



as n ^ oo, 



(1 + a 



2^2 



[a 



[a 



l)(F,,_i + n,+i) + (l + 2a-«2)^, 
+ Ys,+i) + (1 + 2a - a^)iJe 



Proof. Using fl3.4.5p . (13.4. lip and (13.4. 12p . by the very same arguments as in the proof of 
(13.2. ISp . one can obtain (I3.4.13p . Now we turn to prove (I3.4.14p . Using the notation 



Bl : -- 



1 + (5t)2 
1 + (5t)2 



by (i3X6\\ and fl3X71) . we have 



nJ 



(1 + {a\f)Y,, - al{Y,,^i + - (1 - 5t);x, 

_(1 + {alf)Y,, - 5t(r,,_i + - (1 - 5t)^ 

holds asymptotically as n — )■ oo with probability one. Theorem 13.4.11 yields that 



P hm Bi 



By (I3A9|) and fl3.4.1()l) . we have 



1 + 
1 + 



■(1 + (5t)2)r,^ - 5t(K,^_^ + y^^^^) _ (1 _ 5t)^^ 
(1 + (5t)2)y;^ _ 5t(y^^_^ + y,,+,) - (1 - 5t)/i, 



(1 + a^)Ys, - a(n,-i + - (1 - a);u, 

(1 + a^)Y,^ - ^(n^-i + n^+i) - (1 - 



■(1 + {alf )Y,, - 5t(y^^_, + y.,,^,) - (1 - gt)^^ 
(1 + {alf )Ys, - al{ys.-i + - (1 - 5t);x, 

(1 + a2)y^^ _ a{Ys,-i + - (1 - 

(1 + - a(Ys^-i + ^.2+i) - (1 - 



-rV^{{Bi)-'-{B^)-') 



(1 + a2)K,^ _ a(r,^_i + - (1 - 

(1 + a^)Ys^ - a(n,-i + Ys^+i) - (1 - 
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and hence 



t _ 



+ v/^(i?t)-i(5t_5t)(5t)-i 



{1 + a^)Ys, - a{Ys,-i 
{l + a^)Y,,~a{Y,,^, 



Then 
(3.4.15) 



a 



Li 



(1 - a)^ie 
(1 - a)iie 



holds asymptotically as n — t- oo with probability one, where 



By fl3A8l) . we have 







(5t)-i 



(1 + - a{Ys,^i + - (1 - 

(1 + a^)Y,^ - 0(^2-1 + Ys^+i) - (1 - 



ji n 



converges almost surely as n — > oo to 



2«n, - 








-1 


-2a 










-2a 



Fs2 + 1 + ^£ 



(5t)-i 



(1 + _ a{Ys,-i + Y^.+i) - (1 - 

(1 + _ a{Y,,^i + - (1 - a)/i. 



(1 + a 



2^2 



l)(y;,_i + F,,+i) + (l + 2a-a2)^^ 
l)(y;,_i + Ys,+i) + (1 + 2a - a2)/i. 



By 03.4.151) . fl3.4.13p and Slutsky's lemma, we have fl3.4.14p . 



□ 



3.5 Two neighbouring outliers, estimation of the mean of the off- 
spring distribution and the outhers' sizes 

In this section we assume that 1 = 2 and that the relevant time points Si, S2 G N are 
known. We also suppose that Si := s and S2 '■= s + 1, i.e., the time points Si and S2 are 
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neighbouring. We concentrate on the CLS estimation of a, di and 62. Then, by f l3.4.ip . 

aYfc_i + /ie if 1 ^ A; ^ Si — 1 = s — 1, 

alfe-l + yUe + ^1 if /c = Si = S, 

Ct^fe-l + /^e — Ck^l + ^2 if A: = S + 1 = Si + 1 = S2, 

aYk-i + /ie — «^^2 if A; = s + 2 = si + 2 = S2 + 1, 

^aYfc_i + /i£ if A;^s + 2 = S2 + 2. 



Hence 
(3.5.1) 

n 



A;=l 



= J2 {Yk- aYk.i -fiey+ {Ys - aF,_i - - 6,)' + (y,+i - aY, - /i, + a^i - 62)'' 



k=l 



+ {Ys+2 - aYs+i - He + €(62^ , n^s + 2, n G M. 
For all ^ s + 2, n G N, we define the function QlJ : R"+^ x -> R, as 



5Z (^^ ^ " Z/fc-i - /^e)^ + (l/s - a'ys-i - fJ's- O'lY + {Vs+i - a'Vs - f^e + ad[ - O2Y 

k=l 
k^{s,s+l,s+2} 

+ {y,+2 - ay^+i - fis + "'^a)', Yn e M"+\ a', e[, e'2 G M. 

By definition, for all n ^ s + 2, a CLS estimator for the parameter (a, ^i, 62) G (0, 1) x is 
a measurable function {a}} , 6*/!^, 6*2^) : — > such that 

Qn (yn; 5^^(yn), ^iUyn), ^J,Uyn)) = ^ , inf Ql^yn; ^1, ^2) V y„ g 5„, 

where 5^ is suitable subset of M"+^ (defined in the proof of Lemma [3.5. II) . We note that we 
do not define the CLS estimator (5^"'', 6^/1^, 6'2j^) for all samples y„ G M"+^. We have 

— (y„;a ,^1,^2) 



dot' 



A;=l 
fc^{s,s+l,s+2} 

+ 2(|/,+i - - /i. + «'^'i - ^2) + ^'1) + 2(l/s+2 - a'y.+i - /ie + (y'02) i-Vs+i + O2), 



and 



f (y„; a', 6'^) = -2{y, - a'y^-i - - e[) + 2a'(|/,+i - a'y, - /i, + a'^i - ^^^) 



09. 



7-(y„; a', 6'^, 9'^) = -2{ys+i - ays - /ie + a9[ - 9'^) + 2a\ys+2 - a'Vs+i - (J^e + a'9'2) 
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The next lemma is about the existence and uniqueness of the CLS estimator of (a, 6*1, ^2) ■ 
3.5.1 Lemma. There exist subsets Sn C R"''"^, n ^ s + 2 with the following properties: 

(i) there exists a unique CLS estimator (5^^ ^i,^, ^2,ti) : Sn K^, 

(ii) for all yn e Sn, (5^^(yn), 6'i,Uyn), 6'2,Uyn)) is the unique solution of the system of 
equations 



(3.5.2) 



^{yn;a',e[,e',)^0, 
^{yn;a',9[,e',)^0, 

^{yn;a',e[,0'2)^0, 



(iii) Y„ e Sn holds asymptotically as n — >■ 00 with probability one. 

Proof. For any fixed y„ G M"+^ and a' E R, the quadratic function 3 {0[,92) ^ 
Qn{yn', Qi', d'l, ^2) can be written in the form 

Qi\yn,a',e[,e',) 



where 



0[ 

0'2 



- Ania')-Hn{yn;Oi')\M(^') 



0[ 

0'2 



-An{a')-Hn{yn;oi') \+ Q^^ {yn, a') , 



(1 + {a'f)ys - a'{ys-i + ys+i) - (1 - a')^^ 
(1 + {a'f)ys+i - a'{ys + ys+2) - (1 - Q;')a*£ 



<5n (yn; a') XI ~ (^'Vk-if - tniyn, a'yAnia') 4„(y„; a'), 



k=l 



An(a') :-- 



,/^2 



l + {a')" -a' 
-a' 1 + {a'f 



Then Qi\yn;a') = /2„(y„; where Dn{a') := (! + («')')'-("')' = («')'+(«')' + ! > 

and M 9 a' I-)- Rn{yn', ct') is a polynomial of order 6 with leading coefficient 



s+l) 



k=l 



Let 



^tt {y^ e R"+i : c„(y„) > 0} . 
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For y„ e , we have lim\a'\-^ooQniyn',C(') = oo and the continuous function M 9 a' i— )■ 
Qniyn] «') attains its infimum. Consequently, for all n ^ s + 2 there exists a CLS estimator 

{al^,elle^l):Sl^ where 

Qniyn, al^Yn)) = inf Ql^yn] «') V y„ G 

a'GR 



(3.5.3) 



oSniy. 



and for all yn G S'^''', (ct,I^(yn), 6'/|j(y„), ^2^(yn)) is a solution of the system of equations 
By (12X51) and (i2X6|) . we get P flim„^oo ^^"^c„(Y„) = EX^) = 1, where X denotes 



a random variable with the unique stationary distribution of the INAR(l) model in fl2.1.ip . 
Hence Y„ G S}} holds asymptotically as ri — )■ oo with probability one. 

Now we turn to find sets 5*^ C Sj^ , n ^ s + 2 such that the system of equations fl3.5.2p has 
a unique solution with respect to {a',9[,9'2) for all y^ G Sn- Let us introduce the (3 x 3) 
Hessian matrix 











de[da' 










da'de[ 










d^QV 






my 



(y„;a ,^'1,^2) 



and let us denote by Aj „(y„; a', ^^'j^, 6*2) its i-th order leading principal minor, i = 1,2,3. 
Further, for all n ^ s + 2, let 

Sn := {yn G : A,,„(y„; a', e[, 6',) > 0, ^ = 1, 2, 3, V (a', e[, 9'^) G M^} . 

By Berkovitz [TOl Theorem 3.3, Chapter HI], the function 3 0;, Q'^) ^ Ql"^(yn; a', ^'1, ^2) 
is strictly convex for all y„ G S'„. Since it was already proved that the system of equations 
(13.5.21) has a solution for all y„ G S"^^, we obtain that this solution is unique for all y„ G S'„. 

Next we check that Y„ G holds asymptotically as n — )■ 00 with probability one. For 
all {a',e[,e'^) G M^, 



^(Y„; a', = 2 ^ yI, + 2^^^ + 2(r, - e[f + 2(n+i - O'.f 



k=l 

k^{s,s+l,s+2} 



2 Yl ^k-i + 2(X, + - + 2(X,+i + 02-^2 



/ \2 



k=l 
fc^{s+l,s+2} 
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and 



92gtt 



: 2(X, + - 2a'X,+, - /X, + (^1 - 9[) - 2a' {02 - e'2)) , 
g^,{Yn;a',e'„e'2)^2{{a'r + l), 
-.^^iYM0'2)--2a'. 



Then i7„(Y„; a', 6'2) has the following leading principal minors 

n 

Ai,„(Y„; a', 9',, e'2) ^ 2 ^ + 2{X, + 61- e',f + 2{X,+^ + 62- ^^)^ 



k=l 
k^{s+l,s+2} 



( 



A2,n(Y„;a',^i,^^)=4 ((«')' + !) 



^ + {X, + ^1 - + + ^2 - ^ 



I fc=i 

\fe0{s+l,s+2} 



- + - 2aX - - 2a'(^i - ^i) + (^2 - ^2))' , 



and 



A3,n(Y,; ^1, ^2) = det i/n(Y„; a', ^i, e'2) 

( . 



= 8 



((«'r+(aO' + l) 



J] + {X, + ^1 - + + ^2 - ^^)' 



1 A;=l 
\fc0{s+l,s+2} 



where 



2olah - {{ply + \)h' - {{ply + l)a 



a := + - 2olX, - - 2a'(^i - Q'^) + (^2 - ^2), 
6 := X, + X,+2 - 2a'X,+i - + {Q^ - Q'^) - 2a' {62 - e'2). 
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By (I22SD, 



P lim -Ai,„(Y„;a',e;,0^) = 2EX\ V {a',e[,e',) e B 
P ( lim -A2,„(Y„; a', ^^^) = 4((a')' + 1)EX2, V (a', e[, 9',) E 



G 1 = 1, 



P ( lim -A3,„(Y„; a', 9[, 9',) = 8((a')' + + 1)EX2, V (a', 

where X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in f l2.1.ip . Hence 

P( lim A,,„(Y„; a', 9[, 9',) = cx), V («', 9[, 9',)eR') = l, ^ = 1, 2, 3, 

which yields that Y„ G asymptotically as n — t- oo with probability one, since we have 
already proved that Y„ G Sj^^ asymptotically as n — )■ oo with probability one. □ 

By Lemma 13.5.1^ (5^^(Y„), 6'mY„), 6'j|^(Y„)) exists uniquely asymptotically as n — )■ cxd 
with probability one. In the sequel we will simply denote it by (5^^ 9^^^, ^2,!i)- 

An easy calculation shows that 



1 + (5tt)2 


-5tt 






-5tt 


1 + (5tt)2_ 




. 2,n. 



(3.5.4) 5T 
and 



(3.5.5) 

Ys+i - a}}Ys - /ie - al\Ys+2 - otl^Ys+i - /^e 

hold asymptotically as n ^ oo with probability one. Recalling that Dnip.}^) = (5^"'')^ + 
(5^^)^ + 1 > 0, we have 

1 



01 



tt 



(3.5.6) 



and 



Dja 



tt^2 



+ a 



tt 



Ys - al^Ys-i - lie- Oi}}{Ys+i - al^Ys - /x, 
y^+i - al^Ys -fie- al\Ys+2 - ^l^Ys+i - fie 



9 



tt 

2,n 



tt> 



a, 



tt 



Y, - a}}Ys^i - fie- a}}{Ys+i - a}}Ys - fie 

(3.5.7) 

+ (1 + (5tt)2) ^Ys+i - al^Ys -fie- al\Ys+2 - a^^Y^+i - fie)] ) 
hold asymptotically as n — ?■ oo with probability one. 

The next result shows that a}^ is a strongly consistent estimator of a, whereas 6'/^ and 
9l\ fail to be strongly consistent estimators of 9i and 6'2, respectively. 
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3.5.1 Theorem. For the CLS estimators {a}} ,9l'^^,92.^nm of the parameter {a, 91,62) G 
(0,1) X N^, the sequence {a}})nm is strongly consistent for all {a, 61,92) G (0,1) x N^, 
i.e., 



(3.5.8) 



P( lim = a) 

n—^oo 

rtt N ('2'tt 



V{a,9i,92) e (0,1) X 



whereas the sequences (6'/„)„gN o,nd (^^2_ri)"-eN are not strongly consistent for any (a, 6*1, 6*2)6 
(0, 1) X N^, namely, 









" Ys ' 




lim 




+ 


1 n— >oo 






Ys+1 





(3.5.9) 

\ L 2,n. 

for all (a, ^1,^2) G (0,1) x 
Proof. Using that for aU pi e 



-a(l+a^)ys-i-a^n+2-(l-a^)Me ' 
-a^n-i-a(l+a^)ys+2-(l-a'^)M^ 



sup 



z = 0,l,...,4, 
Po + pia; + p2x'^ + psx^ + ^4^"^ 



< 00, 



1 + a;2 + x"^ 

by f l3.5.6p and fl3.5.7p . we get the sequences (6'/|j)ngN and (6'2li)n.eN are bounded with 
probability one. Hence using fl3.5.4p . by the same arguments as in the proof of Theorem 13. 2. H 
one can derive ([331]). Then ( 13X8]) . f l3X6|) and (13X71) yield f l3X9|) . 

The asymptotic distribution of the CLS estimation is given in the next theorem. 
3.5.2 Theorem. Under the additional assumptions EXq < 00 and Eel < have 



□ 



(3.5.10) 



tt 



a] 



A/'(0, 



as n 00, 



where ^ zs defined in fl2.2.9p . Moreover, conditionally on the values Y^-i ond Kj+2; 

'V^{9ll~\im,^^9ll) 
_V^{9^l-lim,^^9ll)_ 

where fa,e defined by 



(3.5.11) 



Af 



fa,e^a, efa,e 



as n ^ 00, 



:i + a2 + «4)2 



(a^ - l){a^ + 3a^ + l)F,_i + 2a{a^ - l)y,+2 + "(2 - a){l + a + a^)^, 
2a{a^ - l)n_i + (a^ _ i)(a^ + 3^2 + l)y;+2 + a(2 - a)(l + a + a^)^. 



Proof. Using (13.5.41) and that the sequences (^ii)neN and (6'2|,,)neN are bounded with 
probability one, by the very same arguments as in the proof of f l3.2.15p . one can obtain fl3.5.10p . 
Now we turn to prove (13. 5. lip . Using the notation 



1 + (5tt)2 
-5tt 1 



-a 



tt 



[a. 



by fl3.5.5p . we have 



9^^ 



■(1 + (5tt)2)r^ _ 5tt(F^_^ + Ys+,) - (1 - 5tt)^, 
(1 + {amYs+i - 5tt(n + Ys+2) - (1 - al^)^ie 
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holds asymptotically as n — t- oo with probability one. Theorem 13.5.11 yields that 

1 + —a 



P lim Bl^ 



-a 



a 



By dSHD, we have 



tt^-l 



■(1 + (5tt)2)y; _ 5tt(y^_^ + y^^^) _ (i _ gtt)^^ 



(1 + (5tt)2)F. 



+1 - a. 



tt 



{Y, + - (1 - 5tt)/., 



(1 + a^)Y, - + n+i) - (1 - 

(1 + - + n+2) - (1 - 



and hence 



■(1 + (5tt)2)r, - 5tt(F,_i + Ys+,) - (1 - 5tt)^^ 
(1 + (amYs+i - 5tt(y; + - (1 - 5tt);., 

(1 + _ a{Y,_, + n+i) - (1 - 

(1 + _ aiV, + n+2) - (1 - 



(1 + _ + - (1 - 

(1 + a^)Ys+i - «(n + Ys+2) - (1 - 



a, 



tt _ 



)((5tt + a)y;-y;_i-y;+i + 



+ v/^(5tt)-i(5tt_5tt)(5tt)-i 



(1 + a^)Ys - + F.+i) - (1 - 

(1 + - a(n + n+2) - (1 - 



Then 
(3.5.12) 



^{ejl - iim,_oo ej^,) 

v/^(41,-lim,_oo^tt)_ 
holds asymptotically as n — t- oo with probability one, where 



Ktt 

n 

Ltt 



+ (Bir' 



-r;^tt 



a tt + Q,) 



(fitt)-i 



(1 + a^)Ys - + n+i) - (1 - 

(1 + a^)Ys+i - a(y; + Ys+2) - (1 - 



(att + (y)Ys - - Ys+i + fie 

(5tt + a)Ys+i - n - y;+2 + /i. 



42 



By (EXg), we have 
(5tt)-i 



converges almost surely as n — )■ oo to 



2aYs -Ys-i- Ys+i + ^is 
2aYs+i -Ys- Ys+2 + l^e 



(5tt)-i 



-2a 1 
1 -2a 



(fitt)-i 



;i + a^)Ys - + - (1 - a)^i, 

;i + a^)Ys+i - a(n + y;+2) - (i - 



1 + a2 + 
1 



2aYs - - + fie 
2aYs+i -Y,- Ys+2 + /u. 



a 



-2a^ - Aa^ 



which is equal to fa,ei by an easy, but tedious calculation. Hence, by (13.5. 12p . (13.5. lOp and 
Slutsky's lemma, we have fl3.5.1ip . □ 



3.6 Two not neighbouring outliers, estimation of the mean of the 
offspring and innovation distributions and the outUers' sizes 

In this section we assume that 1 = 2 and that the relevant time points Si, S2 G N are known. 
We also suppose that si < S2 — 1, i.e., the time points si and S2 are not neighbouring. We 
concentrate on the CLS estimation of a, yU^, 6i and 62- 

Motivated by fl3X2D . for all n ^ S2 + I, n G N, we define the function Qt ; xM"^ M, 

as 

n 

■= X] {Vk - a'yk-1 - /iQ + (z/si - a - /^^ - 0[) 

k=l 

ki^{si,si+l,S2,S2+l} 

for all y„ G M""*"^, a' , fi'^,6'1,62 G M. By definition, for all n ^ S2 + 1, a CLS estimator for 
the parameter {a, fi^, Oi, O2) G (0, 1) x (0, 00) x is a measurable function 

{al^iUUlJ:Sn^^' 

such that 

<3n(yn; "I(yn), /^j,„(yn), ^/,n(yn), dlniyn)) 

= , , . ^.^t ^ ,04 '^Uyn; a', ^'1, ^2) V y„ G 5„, 

where S'„ is suitable subset of ]R"+^ (defined in the proof of Lemma I3.6.ip . We note that 
we do not define the CLS estimator (S^, /ilrn ^1 ^2 n) for all samples y„ G M"^^ 

The next result is about the existence and uniqueness of («,!, /i^.m ^i,n5 ^2,n)- 
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3.6.1 Lemma. There exist subsets Sn C M"'"'"^, n ^ max(5, S2 + 1) with the following proper- 
ties: 

(i) there exists a unique CLS estimator {al,Jl^ 91^,02 '■ Sn — >■ R^, 



(ii) for all y„ G Sn, (a^(y„), //^^^(yn), ^/,„(yn), OlniYn)) is the unique solution of the syst 
of equations 



em 



(3.6.1) 



^(y„; a', /x^, e[, 9'^) = 0, ^(y„; a', 9[, 9'^) = 0, 
^(y„; a', /.^, ^i, = 0, ^(y„; a', /.^, 9'^) = 0, 



(iii) Y„ e /ioMs asymptotically as n ^ oo with probability one. 

Proof. For any fixed y„ G M""*"^, n ^ max(5, S2 + 1) and a' G M, the quadratic function 
M.^ 3 {jji'^, 9[, ^2) ^ Qniy-n', a', li-'e: 6*1, ^'2) can be written in the form 



QUyn;a',i,'^,9[,9'2) 



( 



\ 



) 



( 



An{ol) 



VL 



l^e 



0[ 



\ 



where 



tn{yn]OL') :-- 



(1 + ia'f)ysi - + Vs^+i) 

(1 + {a'f)ys2 - a'{ys2-i + ys2+i) 



k=l 



and the matrix 



An{a') 



n 1 — a' 1 — a' 

I -a' l + {a'f 
I -a' 1 + ia'f 



is strictly positive definite for all n ^ 5 and a' G R. Indeed, the leading principal minors of 
An{a') take the following forms: n, 

n(l + {a'f) - (1 - a'f = {n - l){a'f + 2a' + n-l, 
Dn{a') := (l + (Q;')')((n-2)(Q;')' + 4Q;' + n-2), 
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and for all n ^ 5, the discriminant lQ — A{n — 2)^ of the equation {n — 2)x'^ + Ax + n — 2 = 
is negative. 

The inverse matrix An{a')^^ takes the form 

(! + («')')' -(1 -«')(! + («')') -(1 -«')(! +(«')') ' 

-(1 -«')(! + ("')') n(l + («')') -(!-«')' (1-"')' 
-(1 -«')(! + ("')') (!-«')' n(l + («')') -(!-"')' 



DJa' 



The polynomial M 9 a' i— t- D„(a;') is of order 4 with leading coefficient n — 2. We have 
Qn{yn] tt') = Rniyn] C(') / Dn{a') , where R 9 a' I-)- Rn{yn] C(') is a polynomial of order 6 with 
leading coefficient 

n / n \ 2 

c„(y„) := - 2)J2yl-i - Y.y^-' - - + vl) 



fe=l 



Let 



+ 2(?/si + Z/sJ - '^Vs^Vs 



k=l 



5t :={y„GM"+i:c„(y„)>0}. 

For y„ G S^j, we have lim|Q,'|_>.oo Q,l(yn; «') = oo and the continuous function M 9 «' h-)- 
Qn{yn',Oi') attains its infimum. Consequently, for all n ^ max(5, S2 + 1) there exists a CLS 
estimator 6'|^n, 6'|,„) : 5*+ M"^, where 

Qliyn] ai(yn)) = inf Qr[(yn; V y„ G 5^, 



(3.6.2) 



^n(ttr[(yn)) ^^n (yn ; tt^ (yn) ) , 



and for all y„ G 5"^^, («,l(yn), „(yn), 6'/„(yri), „(y„)) is a solution of the system of equations 
(13X11) . 

By fl2.2.5p and fl2.2.6p . we get P ^lim^^oo 't-~^c„(Y„) = VarX^ = 1, where X denotes 
a random variable with the unique stationary distribution of the INAR(l) model in fl2.1.ip . 
Hence Y„ G S\ holds asymptotically as n — )• oo with probability one. 

Now we turn to find sets Sn C 5*^, n ^ max(5, $2 + 1) such that the system of equations 
(13.6. ip has a unique solution with respect to {a' , ^'^.O'^.O^) for all y,„ G S^- Let us introduce 
the (4 X 4) Hessian matrix 



r d^Qi 










dfi'^da' 


de[da' 












da'dfj.'^ 
















da'd9[ 
















\_da'de!2 






d(9'^r J 



{yn;a,n'^,e[,e2), 
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and let us denote by Aj^„(y„; a', /i^, O^) its z-th order leading principal minor, i = 1, 2, 3, 4. 
Further, for all n ^ max(5, S2 + 1), let 

:= {y„ G : A,,„(y„; /i^, 5',, 5^) > 0, ^ = 1, 2, 3, 4, V («', /i^, e[, 9'^) G R^}. 

By Berkovitz ^ Theorem 3.3, Chapter III], the function 3 {a' , jj,'^, e[, O'^) ^ 

Ql^ijn', a' , is strictly convex for all G S'„. Since it was already proved that 

the system of equations (13.6. ip has a solution for all y„ G S*^, we obtain that this solution is 
unique for all y„ G Sn- 

For all ynGM"+^ and (a', /x^, G M^ we have 

^Qn I ' ' n' n' \ 

n 
k=l 

fc^{si,Si+l,S2,S2 + l} 

+ 2(?/si+i - a'vs, - /i', + a'^i) {-Vs^ + 0[) - 2(?/,2 - ays,-i - - ^2)^/^2-1 
+ 2(2/.2+i - a'2/.2 - /x'e + a'e'2){-ys2 + ^2)^ 

^^(y„;a ,/i^,^i,^2) 

n 

= X] (-2) (l/fc - a'vk^i - /iQ - 2{ys, - a'l/si-i - /^^ - ^0 

k=l 

fc0{si,Si + l,S2,S2 + l} 



and 



(3.6.3) 



2(?/^i+i - a'ys^ - /i'^ + a'9[) - 2{y,^ - a'y^^^i - fi'^ - 6*2) 



= -2(l/s, - ays,-i - - 0[) + 2a'(?/,^+i - ay,, - ^^'e + "'^D, i = 1, 2. 
We also get for all (a', /x',, 0'^, O'^) G M^ 

n 

= 2 5^ + 2Yl_, + 2(n, - e[f + 2^2^^^ + 2(n, - 9',f 

k=l 

fe^{si,Si + l,S2,S2 + l} 



= 2 Yl + 2(^s, + - e[Y + 2{Xs, + 02- e'2. 



'2) 1 

k=l 
fc^{si + l,S2+l} 
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and 



^^(Y„; a', e[, e',) = ^^(y^; //^, 

n n 

= 2 J] n_i - 2e[ -2e'^ = 2j2 Xk~i + 2(^1 - ^i) + 2(^2 - ^2), 
fe=i fc=i 

92gt 52gt 

= 2(X,,_i + - 2a%, -11'^- 2a\e2 - 9'^)), z = 1, 2, 



Q^J^O^n] a, ^i, O2) = 2n, 



d{e[) 



^(Y„; a', e[, 6',) = ^7^(Y„; /x^, ^i, = 2((«')' + 1), 



^{Y^; a', e[, e',) = ^^(Y„; a', ^i, = 0, 



;^(Y„; a', //^, e'^) - Tr7lz7(Yn; A^^, e[A) = 2(1 - a'), i = 1, 2. 



The matrix i7„(Y„; a', /x^, 6*'^^, 6*2) has the following leading principal minors 

n 

Ai,„(Y„; a', /x^, 6'^) = 2 J] X^^ + 2(X,, + ^1 - ^'J^ + 2(X,, + 62- e'^)\ 



k=l 

k^{si+l,S2 + l} 



^ n 

J2 xU + (^.1 + ^1 - o',f + {X,, + 62- e',) 

k=l 

V0{S1 + 1,S2 + 1} 



-4[J2Xk-i + {ei-o[) + {O2-02)] , 



A3,„(Y„; a', //^, e[, 0'^) = 8 {{{a'f + l)n - (1 - a')') 



X 



^ + {X,, + e,- e[r + {X,, + 62- e',] 



k=l 

V0{S1 + 1,S2 + 1} 

+ 16(1 - a')L I J2Xk-i + (^1 - ^i) + {02 - ^2) )- 8nL' 



,fc=i 



-8{{a'f + l)lY,X,_, + {e,-& 



1 1,171 - u[) + {62 - 62) 



.fe=l 
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and 



A4,n(Y„; a , /i^, e[, 62) = det HniYn] /x'^, 6''i, 6'f 



2^5 



where L := X,,_i + X,,+i - 2a'X,, - /i', - 2a'(^i - ^'J. By (12:23|) and ([Ml]), we get the 
following events have probability one 

lim -Al,„(Y„;a^/i^,^;,^^)=2EX^ V («', /i',, G 

n^cxD 77, 

hm ^A2,„(Y„;a',/x;,^;,^^) = 4(EX2 - (EX)^) 



4VarX, V (a, /i',, ^2) ^ M^} 



lim — A3,„(Y„;a',/i;,^;,^^^) = 8((a')' + l)VarX, V (a', /i',, 0^) G 

n^oo n 



lim ^A4,n(Y„;«',/x;,^'i,^2) = 16((a')' + 1)' VarX, V (a', /z^, G R% , 

where X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in f l2.1.ip . Hence 

P ( lim A,,„(Y„; a', /i^, e[, O'^) = cx), V (a', /i',, e[, O'^) G M^ 1 = 1, 2, 3, 4) = 1, 

which yields that Y„ G asymptotically as n — )• 00 with probability one, since we have 
already proved that Y„ G S\ asymptotically as n — )• 00 with probability one. □ 

By Lemma I3.6.H (S^(Y„), /i^„(Y„), 6'/„(Y„), 6*2 „(Y„)) exists uniquely asymptotically as 
n — 7- 00 with probability one. In the sequel we will simply denote it by (S^, 6*/^, „). 

The next result shows that o?^ is a strongly consistent estimator of a, is a strongly 

consistent estimator of /i^, whereas 6*/,^ and Ol^^ fail to be strongly consistent estimators of 
6*1 and 6*2, respectively. 

3.6.1 Theorem. Consider the CLS estimators (S^, /i^^^, 6*2 „)neN of the parameter 
{a, fie, ^1, (^2) G (0,1) X (0,00) X N^. Then the sequences (a^)„gN and (/ij„)„gN are strongly 
consistent for all (a, /x^, 6^1, ^^2) £ (0, 1) x (0, 00) x N^, i.e., 



,t2 

5 



(3.6.4) P{\imal = a) = l, V (a, /i^, ^i, ^2) e (0, 1) x (0, 00) x N 

71— >00 

(3.6.5) P( lim /2t^„ = /i,) = 1, V(a,/x„^i,^2) G (0,1) X (0,00) xN^ 



whereas the sequences (6'/„)„gN and (^2„)neN o'^e noi strongly consistent for any 
{a, /ie, 61, 62) G (0, 1) X (0, 00) X W, namely, 

(3.6.6) P ( lim el = - -^(n^-i + n^+i) - ^^/i.) =1, ^ = 1, 2, 

for all (a,/i„^i,^2) G (0,1) x (0, cx)) x N^. 
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Proof. The aim of the following discussion is to show that the sequences — ^i)neN and 

{62 n — ^2)neN are bounded with probability one. By f l3.6.ip . f l3.6.3p and Lemma [3.6.H we get 



(3.6.7) 



i = 1,2. 



By (I3.6.2P and the explicit form of the inverse matrix An{a')^^, we obtain 





1 






Hn 






J n 



where 



Gn :=-(l-St)(l + (at)2) 

X ((1 + {alf){Y,, + Y,,) - + + + F.^+i)) 

n 
k=l 

:= (n(l + {alf) - (1 - a^f) ((1 + {alf)Y,, - 5^(^,-1 + ^,+1)) 
+ (1 - alf ((1 + {alf)Y,, - al{Y,,_, + 

fc=i 

J. := (1 - alf ((1 + (St)2)n, - aliY,^^, + ^,+1)) 

+ + {^l?) - (1 - ((1 + {^lf)ys. - + 



fc=l 



Using (12X51) and that for all G M, i = 0, . . . , 4, 



sup 



,„;^5 (1 + - 2)a;2 + 4x + n - 2) 



< 00, 



one can think it over that Hn/Dn{al), n eN, and Jn/ Dn{al), n G N, are bounded with 
probability one, which yields also that the sequences — Oi)neN and (^J^ — 62)nen are 

bounded with probability one. 

Again by Lemma 13.6.11 and equations (13.6.11) we get that 



"at" 




an 


hn 


-1 








pn 


n 




_dn_ 
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holds asymptotically as n — )■ oo with probability one, where 



k=l 
n 

hn := ^ Xk-1 + 6i- Ol^^ + 62- 6*2 „, 

k=l 
n 

Cn '■= ''^Xk-lXk + {9i — 6'/^„)(Xs^_i + Xs-^+l 
k=l 
n 

dn := ^ Xk + 9i — 9 In + 92 — 6'^ „. 



^2 - ^2,n)(-^S2-l + -'^sa+l). 



k=l 



Here we emphasize that the matrix 



hn n 



is invertible asymptotically as n — ?■ 00 with probability one, since using (12. 2. 51] , (12.2.61] and 
that the sequences (6'/„ — ^^i)„,eN and (9ln ~ ^2)neN are bounded with probability one we get 



(3.6.8) P f hm ^ = EX^) = 1, 

and hence 



hn 



P lim — = EX = 1, 



n— >-oo fi 



P lim ^{nan - hi) = EX^ - {EXf = VarX 



n— 5>c« Tl 



This yields that 



Further 



P ( lim {nUn — hi) = 00) = 1. 









hn 


-1 


*3n 






pn 


n 




fn 



(3.6.9) 

holds asymptotically as ri, — )■ 00 with probability one, where 

n 

en ■= ^Xfc_i(Xfc - aXfc_i - fie) 

k=l 

+ {9, - 9lJ (X,,_i + X,,+i - 2«X,, - - «(^i - 9lJ 
+ {92 - 9ln) (X,,_i + X,,+i - 2aX,, - - a(02 - ^^J) , 

n 

fn := 5^(X, - aXk-i - fie) + (1 - a)(^^i - + ^2 - ^J.J. 



fc=i 
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Then, using again fl2X3ll . f l2X5l) . f l2X6l) . f l2X7l) and that the sequences (61/,^ -6'i)„6n and 
(^2 n ~ ^2)neN are bounded with probabihty one, we get 

P f hm — = aEX^ + /i,EX - aEX^ - /i,EX = o) = 1, 

P ( hm — = EX - aEX - /x, = ) = 1. 
Hence, by (13.6.9^ . we obtain 





a'l - a 




"EX2 


EX 


-1 


o" 




o" 




1 hm 




















1 n— >oo 






EX 


1 















which yields fl3M and fl3M . Then fl3A4D . fl3CT) and f l3X71) imply f l3X6D . 
The asymptotic distribution of the CLS estimation is given in the next theorem. 

3.6.2 Theorem. Under the additional assumptions EXq < oo and Eel < have 



□ 



(3.6.10) 



a) 




o" 














as n ^ oo, 



where Ba^e is defined in f l2.3.2p . Moreover, conditionally on the values Ys^-i, Ys^-i and 



(3.6.11) 

where 



y^(^i,n-limfc^oo^/,fe) 
,Vn{Oln - linifc^oo 



^^ 



; ^ a,e^a,£^ oi,e 



as n OO, 



fl + a2)2 



(a2 - l)(r.,_i + r.,+i) + (1 + 2a - a2)/i, (a - 1)(1 + a' 



(«2 _ l)(F,^_i + Y,,+i) + (1 + 2a - a^)fi, {a - 1)(1 + a' 
Proof. By (I2.3.2p and fl3.6.9p . to prove (13.6. lOp it is enough to show that 

(3.6.12) 









"EX2 


ex" 




I lim — 










) 


\ ?i-s>oo n 


hn ri _ 




EX 


1 





(3.6.13) 







"o" 


7 ^o,e^ 


fn 










as n — )■ oo, 



where X is a random variable having the unique stationary distribution of the INAR(l) model 
in f l2XT]) and the (2 x 2)-matrix is defined in flO^l) . By (ESS]), we have (13.6.121) . By 

formula (6.43) in Hall and Heyde [35, Section 6.3], 



YJk=i Xk-i{Xk - aXk-i - fie 
1 

\fri 



ELl(^fc - OiXk-l - fie 



Af 



1 ^a,e 



as n — > oo. 
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Hence using that the sequences 



and 



rt 



are bounded with probabihty 



one, by Slutsky's lemma (see, e.g.. Lemma 2.8 in van der Vaart [63^), we get (13.6. 13p . 
Now we turn to prove (13.6.111) . Using the notation 



Bi : -- 



1 + (at)2 

1 + {air 



by (I3.6.7p . we have 

^7. 



2,n 



(1 + ialf)Ys, - St(n^_i + n^+i) - (1 - St)^t^ 
(1 + {al)'')Ys, - al{Ys,-i + Ys,+i) - (1 - al)p,^^ 

holds asymptotically as n — )■ oo with probability one. Theorem 13.6.11 yields that 



P lim Bl 



1 + 
1 + 



By (I3.6.6p . we have 



\/^(^/,n - limfc^oo oik) 



(1 + (St)2)y^^ _ sl(Y,,_, + - (1 - at)^t^ 

(1 + (at)2)K,^ _ «t(y^^_^ + K,^^^) _ (1 _ st)^t 



(1 + a'^)Ys, - a{Ys,-i + Y^.+i) - (1 - a)fie 
(1 + _ a(Ys,-i + n.+i) - (1 - a)fi. 



MB 



(1 + (St)2)r,^ - St(y^^_^ + y^^^^) _ (1 _ st)^t 
(1 + (at)2)K,^ - «t(y^^_^ + y^^^^) _(!-«, 



e,n 



nJr"e,n 



(1 + - a(y;,_i + n^+O - (l - 

(1 + _ a(r,2_i + F.^+i) - (1 - 



(1 + a2)y^^ _ a{Ys,-i + F.^+i) - (1 - 
(1 + a^)Y,, - a{Ys,-i + F.^+i) - (1 - 



(St + a)y;, - (r,,_i + y;,+i 
(St + a)y;, - {Ys,-i + + A 



t 



a 



St — a 



+ v^{Bir\B^-Bi)iB^)-' 



(1 + _ a{Ys,-i + Y^.+i) - (1 - a)fi, 

(1 + _ a{Ys,-i + n^+i) - (1 - 
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Then 
(3.6.14) 



holds asymptotically as n — )■ oo with probability one, where Cn,a,e is defined by 



{al + a)Ys^ - Ys.^i - Y^.+i + p^^„ a-1 
(at + a)Ys^ - - F.^+i + /I a-1 



(a. 



+ a)(5t)-i(5t)-i 



(1 + a^)Y,, - a(n,_i + - (1 - a)i2, 

(1 + a^)Ys, - a(y;,„i + - (1 - a)/i, 



By fl3.6.4p and fl3.6.5p . we have Cn,a,e converges almost surely as — )• oo to 



(i?t)-i 



2aY 



2aYs, - Y, 



Ys^-i - Ys^+i + fie a-1 
S2-1 ~ Ys2+i + A^e a — 1 



-2a 
-2a 



(1 + a^)Ys, - a(r,,_i + Ys,+i) - (1 - a)/i, 
(1 + a2)F,^ - a(y,,_i + - (1 - a)fi. 



1 



a" - l)(n,-i + + (1 + 2a - a2)/i, (a - 1)(1 + a^) 

a2 - l)(F.,_i + + (1 + 2a - a^)/!, (a - 1)(1 + a^) 



(1 + a2)2 

By (13.6.141) . (13.6. lUp and Slutsky's lemma, we have (I3.6.1ip . 



□ 



3.7 Two neighbouring outliers, estimation of the mean of the off- 
spring and innovation distributions and the outUers' sizes 

In this section we assume that 1 = 2 and that the relevant time points Si, S2 G N are 
known. We also suppose that Si := s and S2 '■= s + 1, i.e., the time points Si and S2 are 
neighbouring. We concentrate on the CLS estimation of a, /i^, 61 and 62- 



Motivated by (IX^ . for all n ^ s + 2, n G N, we define the function Qtt ; ^n+i ^ ; 



as 



Qn {yn, a ,fi'^,e[, 02 



[Vk - <y'yk-i - fi'^Y + {vs - ot'ys-i - At^ - d[Y + - ays - /i'^ + a'6'i - 6'^)' 



k=l 
fc^{s,s+l,s+2} 



+ {ys+2 - a'ys+i - fi', + a'^Q', y„ G M"+\ a', fi'„ e[, B'2 G R. 
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By definition, for all n ^ s + 2, a CLS estimator for the parameter (a, /ig, ^i, ^2) G (0, 1) x 
(0, 00) X is a measurable function (a^^ /ij^jj, ^1^, 6*21^) : S'„ — )■ M"^ such that 

{o',/i^,e^,0^)GiR'i 

where S",! is suitable subset of R"+^ (defined in the proof of Lemma [3.7. ip . We note that 
we do not define the CLS estimator {a}^ ^'jlp^^ Ol^^ Ol'^^) for all samples y„ G M""*"^. For all 
y„GM-+i and (a', /i^, G M^ 



and 



fc=i 

fe0{s,s+l,s+2} 

— -^(y„;a ,/i^,^i,^2 



fc=i 

fe^{s,s+l,s+2} 

- 2(|/s+i - a'l/s - /i'e + a'6l'i - 6*2) - 2(?/s+2 - a'z/s+i - At^ + "'6*2), 



^(y.;a',/z;,^;,^^) 

= -2(ys - a - /u'e - Q'^ + 2a'(?/^+i - ay^ - /i'^ + a'6''i - 6*2), 

= -2{ys+i - ays - fi'e + aO[ - 6*2) + 2a{ys+2 - ay^+i - yU^ + a'6'2). 
The next lemma is about the existence and uniqueness of the CLS estimator of {a, fi^, ^1, 62)- 
3.7.1 Lemma. There exist subsets Sn C M"^^, n ^ max(3, s+2) with the following properties: 

(i) there exists a unique CLS estimator (a^"!", /i^^^ ^tt^^ ^tt^) ; ]^4^ 

(ii) for all y„ G Sn, (a^"^(y„), /i^^^yn), ^/,n(yn)) ^2,n(yn)) t/ie TOzgwe solution of the system 
of equations 

^(y„; a', 0^) = 0, ^(y„; a', /x^, 9',) = 0, 

(3.7.1) ^^'^ 

-^(y„;a ,/i^,^i,^2) = 0, ^^(y„; a , /i^, ^i, ^2) = 0, 
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(iii) Y„ e Sn holds asymptotically as n ^ oo with probability one. 



Proof. For any fixed y„ e R""*"^, n ^ max(3,s + 2) and a' e R, the quadratic function 
3 [jj!^, d[, 62) ^ Ql^iYn] Oi', ji'^, 9[, ^2) can be written in the form 



I 



- An{a') ^tn{yn;Ol'] 



where 



( 



An{0l) 



I 



9' 



\ 



- An{a') hn{yn,Ol') 



{l + {a')'')ys-a\ys-i + ys+i) 
(1 + {a'f)ys+i - a'{ys + ys+2) 



k=l 



and the matrix 



AJa') :-- 



n 



1-a' 1-a' 



I -a' 1 + {a') 



i\2 



-a 



I -a' -a' 1 + {a'f 



is strictly positive definite for all n ^ 3 and a' e R. Indeed, the leading principal minors of 
An{a') take the following forms: n, 

n(l + {a'f) - (1 - a'f = {n - l){a'f + 2a' + n-l, 

Dn{a') := n(l + (a')')' - 2(1 - o;')'(l + - 2q;'(1 - a')' - ^(q;')' 

= n(l + a'+ - a' + (a')') - 2(1 - a'f{l + a' + (a')') 

= (1 + a' + (a')') ((^ - 2) (a')' - (n - 4)a;' + n - 2) , 

and for all n ^ 3, the discriminant {n — 4)^ — 4(n — 2)^ = — 3n^ + Sn of the equation 
{n — 2)x^ — (n — 4)x + n — 2 — is negative. The inverse matrix An{a')~^ takes the form 

1 + («')' + (a')' -(1 + + -(l-a')(l + «' + («')')' 

-(1 -aO(l + a'+ (a')') n(l + (a')') - (1 " {1 - a')^ + na' 

-(l-a')(l + «' + («')') (l-aO' + ^a' n(l + (a')') - (1 - 



i^n(«') 



The polynomial R 9 a' i->- Dn{a') is of order 4 with leading coefficient n — 2. We have 
Qn (yn; ck') = RniYni Oi')/Dn{a'), whcrc R 9 ct' !->■ RniYni Oi') is a polynomial of order 6 with 
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leading coefficient 

n 



k=\ 



k=l 



Let 



^„tt := {y„ e M"+i : c„(y„) > O} . 

For y„ G S^'^ , we have lim|a/|_^oo Qi^lYn; a') = 00 and the continuous function M 9 a' 1— )• 
Qniyn] «') attains its infimum. Consequently, for all n ^ max(3, s + 2) there exists a CLS 
estimator («tt, ^tt^^ ^tt^^ ^ttj . ^tt _^ ^^ere 

&{yn, Stt(y„)) = inf Qtt(y^. c,') V y„ G 5^, 



(3.7.2) 



^2i(yr! 



G 5'J"'', 



and for all y„ G ("riHyn), /^^^(yn), ^iV„(yn), ^J,Uyn)) is a solution of the system of 

equations (13.7. ip . 

By (I2.2.5P and (I2.2.6p . we get P ^lim„_^oo "■~^c„(Y„) = VarX^ = 1, where X denotes 
a random variable with the unique stationary distribution of the INAR(l) model in (I2.1.ip . 
Hence Y„ G S^^ holds asymptotically as n — 00 with probability one. 

Now we turn to find sets Sn C S}J , n ^ max(3, s + 2) such that the system of equations 
(13.7.11) has a unique solution with respect to {a' , fi'^,9[,9'2) for all y„ G Sn- Let us introduce 
the (4 X 4) Hessian matrix 



r 92 Qt 








d{a'y 


dfi'^da' 


d9[da' 












da'dfj.'^ 
















da'de[ 

























{yn]a',fj.'^,9[,92), 



and let us denote by Aj „(y„; a', ji'^, 9[, 9^) its i-th order leading principal minor, 2 = 1,2, 3, 4. 
Further, for all n ^ max(3, s + 2), let 

Sn := {yn G : A,,„(y„; a', 9[, 9'^) > 0, z = 1, 2, 3, 4, V (a', /i',, 9[, 9'^) G M^}. 

By Berkovitz [H Theorem 3.3, Chapter 111], the function 3 {a' , ^i'^, 9[, 92) ^ 

(yn; /^£5 ^2) is strictly convex for all y„ G Sn- Since it was already proved that 
the system of equations (13.7.11) has a solution for all y„ G S]} , we obtain that this solution is 
unique for all y^ G Sn- 
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Next we check that Y„ e Sn holds asymptotically as n ^ oo with probability one. For 
all {a',ij,'^,9[,9'^) e M^ 

n 

k=l 
fc^{s,s+l,s+2} 

n 

= 2 + 2(^. + ^1 - 0[f + 2(X,+i + ^2 - ^2)', 



k=l 
k^{s+l,s+2} 



and 



2 J] n_i - 2^i - 2^^ = 2 J] + 2(^1 - + 2(^2 - ^2) , 



A;=l k=l 



= 2(n_i + n+i - 2aX - + 2a'^l - 6'^) 

= 2(X,_i + - 2a'X, -fi'^- 2a\e^ - e[) + (^2 - ^2)), 

= 2(y, + y,+2 - 2Q;'y,+i - //^ - + 2q;'^^) 

= 2{Xs + X,+2 - 2q;X+i - //^ + (^1 - ^i) - 2q;'(^2 - ^2)), 



and 



|||(Y„;a',/.^,e;,^^) = |^(Y„;a',/.^,^;,e^) = 2((aO^ + l), 
QQTQQrjyn] a , /x„ 9^, 9^) = QQ^O^n] a , /x„ ^2) = -2a , 

Q^i^n.a\^,AA) = ^^(Y„;a',/.;,^i,^;) = 2(l-a'), 
^(Y.; 9[, 9'^) ^ ^(Y.; ^ 2(1 - a'). 



57 



'2) ) 



Then HniYn] ot , /i^, Q'^ has the following leading principal minors 

n 

Ai,„(Y„; a', /i',, 9'^) = 2 J] + 2(X, + - ^^1)2 + 2(X,+i + 92-9'^ 

k=l 
k^{s+l,s+2} 

( " ^ 

xl-i + (^s + ^1 - e[f + (x,+i + ^2 - e'^f 
4(X^x,_i + (0i-0;) + (02-^2) 



A2,n(Y„; a', /i^, 612) = 4n 



and 



/ n \ 

J2 ^li + i^s + 0i- 9[f + (X,+i + 92- 9',f 

\k<^{s+l,s+2} / 



+ 16L Xfe_i + (^1 - 9[) + (02 - ^2) j - 8^^' 
- 8((a')' + 1) E^^^-i + - ^1) + - ^2; I , 

\A;=1 



0;,0^) = det//„(Y„; ^'1,^2), 
where L := X,_i + X,+i - 2a'X, - /x^ - 2a'(0i - 0^) + ^2 - 9'^. By (|2X5|) and (l2X6|) . we get 

pf lim -Ai,„(Y„;a',/i;,0;,0^)=2EX2, V (a', /x'„ ^i, 0^) G I 



P hm -A2,„(Y„;a',/x;,0;,0^) = 4(EX^-(EX)^) = 4VarX, V (a', /i^, 0',, 0^) G MM = 1, 
and 

pflim ^A3,„(Y„;a',/x;,0;,^^^) = 8((a')' + l)VarX, V («', /x',, ^i, 0^) G M^) =1, 
pflim ^A4,„(Y„;a',/x;,^^;,0^) = 16((a')' + (a')' + l)VarX, V (a', /x',, ^^^) G M^^ =1, 

where X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in (I2.1.ip . Hence 

P(lim A,,„(Y„;a',/x;,0;,0^) = oo, V (a', /x^, ^1, 0^) G M^) = 1, z = 1,2,3,4, 
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which yields that Y„ G Sn asymptotically as n — t- oo with probability one, since we have 
already proved that Y„ G Sj^ asymptotically as n — !■ oo with probability one. □ 

By Lemma [3.7. H (q'^"''(Y„), /itt^(Y„), 6'/|j(Y„), 6'2|j(Yn)) exists uniquely asymptotically as 
n — )■ oo with probability one. In the sequel we will simply denote it by {a}}, 'Ul^-, 6'j|j). 

The next result shows that a}} is a strongly consistent estimator of a, is a strongly 
consistent estimator of /i^, whereas Ol'^^ and fail to be strongly consistent estimators of 
Oi and 6*2, respectively. 

3.7.1 Theorem. Consider the CLS estimators {a}} ,11^^,61^,62 r^nm of the parameter 
{a, fie, 61, 62) G (0,1) X (0,00) X N^. The sequences {al'')ne'N and {jlp^nm o'^e strongly 
consistent for all (a, /i^, ^1, ^^2) £ (0, 1) x (0, 00) x N^, i.e., 



(3.7.3) 
(3.7.4) 



P( lim ajt = c^) = 1^ V (a, ^u^, ^1, 62) G (0, 1) x (0, 00) x 
P( lim = f^e) = 1, V (a, /i„ ^^1, 62) G (0, 1) X (0, 00) x 



whereas the sequences (6'it)neN o^nd (6'2,li)neN noi strongly consistent for any 

{a, Us, 61, 62) G (0, 1) X (0, 00) X W, namely, 

lim = + 

2'tt y ,1 -a^n-i-a(l+a^)ys+2-(l-a'')Me 

_f^2,nj L ■^+^J L 1+0:2+0,4 

/or a// {a,fie,0i,02) e (0,1) x (0, cx)) x N^. 
Proof. An easy calculation shows that 

/ n \ 



a. 



ft 



Y.^k-i-6ll-6g]jl}l 



E n-in - + n+i) - ^J,Un + n+2) + 



A:=l 



,fc=l / k=l 

hold asymptotically as n — )■ 00 with probability one, and hence 









bn 


-1 








pn 


n 




P 



(3.7.6) 

holds asymptotically as — )■ 00 with probability one, where 

n 

a„ := E^Li + (^1 - 011m - 0ll + 2X.) + {62 - - ell + 2^^+i) 



k=l 



6, := E ^-t-i + ^1 - + ^2 - ^j: 



■ft 



fc=l 
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and 





— a 






K 


-1 


Cn 








pn 


n 







K:=Y1 ^k-iXk + (e, - ell) + + - e^l) (x, + ^,+2) + (^1 - ell) {e^ - e^l) , 

k=l 

n 

fc=l 

Furthermore, 
(3.7.7) 

hold asymptotically as n — > oo with probability one, where 

n 

Cn := Yl ^k-ii^k - - //e) + (^1 - ell) {Xs-i + Xs+i - 2aX, - /x, - a{e^ - ell)) 

k=l 

+ {e^ - eg) {X, + - 2ax,^, -f,,- aie^ - eg)) + {e, - eljjie^ - eg), 

n 

dn J2^Xk - aXk-1 - + (1 - a)iei - eg + ^2 - eg). 

k=l 

We show that the sequences (6*11^ — ^i)„gN and {eg — e2)nm are bounded with probability 
one. An easy calculation shows that 

n 

niig + (1 - al^)ell + (1 - al^)eg = ^^(n - sttn_o, 

k=l 

(1 - al^)pg + (1 + (att)2)^tt - al^eg = (1 + (Stt)2)F, _ al\Y,_, + 

(1 - ^mi - ^I'og + (1 + i^lWg = (1 + - Stt(y, + y,+2), 

hold asymptotically as n — > 00 with probability one, or equivalently 



(3.7.8) 



n 



1 - S tt 1 _ stt 



1-Stt l + («tt). 

















e^^ 





Yi=.{yk^^}^Yk-.) 

(l + (Stt)2)y,_stt(i;_i + y,+i) 
(l + (att)2)y^_,,_Stt(y^ + y^^,) 



_1 - att _Stt 1 + («tt)2 
holds asymptotically as n ^ 00 with probability one. Since for all n ^ 3 

L>„(Stt) = (1 + Stt + (att)2) ((^ _ 2)(Stt)2 _ (^ _ 4)Stt + n - 2) > 0, 
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we get asymptotically as n — t- oo with probability one we have 
(3.7.9) 

•ft" 

1 



tt 



01 



1 + (Stt)2 + (Stt)4 Un 

Un Wn Vn 

Un Vn Wn 



(l + (att)2)y^-«tt(F,_, + F,^,) 
(l + (Stt)2)y;^i-att(y^ + y^^,) 



1 



Dnia 



tt^ 



Gn 
Hn 
J n 



where 



u 



= -(l-«tt)(i + 3tt + (3tt)2)^ 

Vn ■■= (1 - al^y + nal\ 

Wn := n(l + (Stt)2) _ (1 _ Stt)2, 



and 



G„ :- 



k=l 

Hn := + {am - (1 - SD') ((1 + i^mYs - «r + ^s+i)^ 
+ ((1 - + nStt) ((1 + (Stt)2)y^^^ _ 5tt(y^ + y^^^)) 

n 

- (1 - Stt)(l + Stt + (att)2) - attn_0, 

A:=l 

Jn := ((1 - Stt)2 + nStt) ((1 + (Stt)2)y; - stt(y;_i + 

n 

- (1 - att)(i + ^tt + (Stt)2) ^(y^ _ gtty^ 



■ fc-i J 



fe=i 



Using (E^ and that for all G M, i = 0, . . . , 4, 

n(p4x'^ + pax^ + p2x'^ + pix + po) 



sup 



,„eN (l + x + x2)((n-2)x2 - (n - 4)x + n - 2) 



< oo, 



one can think it over that Hn/ Dnia}^), ti G N, and Jn/ Dn(a}^), n G N, are bounded with 
probability one, which yields also that the sequences ~ ^i)neN and (62^n ~ ^2)neN are 

bounded with probability one. 
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By the same arguments as in the proof of Theorem 13.6. 11 one can derive (13.7.3P and f l3.7.4p . 
Indeed, using ([2231), fl^:^ and (ITT7|) . we get 



P f hm ^ = EX^) = 1, 

Vn->oo n / 



Pi hm — = EX 1 = 1, 



P ( hm — = aEX2 + /i,EX ) = 1, 

\n-s>oo n J 



P ( hm — = EX = 1, 

^n-5>oo n I 



P f hm — = aEX^ + /i^EX - aEX^ - /i,EX = o) = 1 

Vn-s>oo n / 

P ( hm — = EX - aEX - /i^ = ) =1. 



Hence, by (13. 7. 71) . we obtain 



P I hm 

n— ^-oo 



a}^ — a 



EX2 EX 
EX 1 



which yields fl3T:3D and (13^1) . Then (jSZl, fl3T:4l) and (KT9\i imply f l3T3D . Indeed, 



P hm 



D„(Stt 



1 + a + a 



V (a,/i„^^i,e2) G (0,1) X (0,oo) X 



n— s>oo n 

and converges almost surely as n — )■ oo to 

(1 + a^) ((1 + a^)Ys - a{Ys-i + n+i)) + a ((1 + a^)^,^! - a(n + ^+2; 

- (1 - a)(l + a + a2)(l - a)EX 

= -a(l + + (1 + + a^)Y, - a^y^+a - (1 - 

and ^ converges almost surely as n ^ 00 to 

a ((1 + a^)Ys - + F.+i)) + (1 + a') ((1 + - «(n + ^+2; 

- (1 - a)(l + a + a2)(l - a)EX 

= + (1 + + - a(l + a^)Fs+2 - (1 - a^)f^e- 



The asymptotic distribution of the CLS estimation is given in the next theorem. 
3.7.2 Theorem. Under the additional assumptions EXq < 00 and Eef < 00, we have 



□ 



(3.7.10) 





'0 












as n 00, 



where Ba,^ is defined in f l2.3.2p . Moreover, conditionally on the values Yg-i o,nd Ys+2, 



(3.7.11) 



■ft 



7~) R n 

7 -'-^a,e-DQ,£-l^Q!,£ 



as n ^ 00, 
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where the (2 x 2) -matrix Da^e is defined by 

' {a'2-l){a^+3a'^ + l)Ys-i+2aia^-l)Y,+2+a(2-a)il+a+a'2)^ ^J., 



(l+a2+a4)2 

2a{a'^-l)Ys-l + {a'^-l){a'^+3a^+l)Y,+2+a{2-a){l+a+a'^f^l, 
(l+a2+a*)2 



l+a2+a4 



Proof. Using ( 13.7.7^ and that the sequences {9l\ — 9i)nen and (6*2!, — 92)nm are bounded 
with probabihty one, by the very same arguments as in the proof of fl3.3.1ip . one can obtain 
(I3.7.10p . Now we turn to prove fl3.7.1ip . Using the notation 



-a 



tt 



-Stt 



1 + 



by fl3.7.8p . we have 



■(1 + iamYs - + - (1 - «tt)^ 

(1 + (Stt)2)r,^, - stt(r, + r,+2) - (i - stt)/^, 



holds asymptotically as n — )■ 00 with probabihty one. Theorem 13.7.11 yields that 

"l + «2 



P hm B]^ 

Again by Theorem 13.7.11 we have 

'^{9ll-\im,^^9l\) 
.v^(^?n-lini.^oo^il) 



-a 



-a 



1. 



(1 + {^mYs - KKYs-i + n+i) - (1 - stt)^tt ■ 

_(i + {amYs+i - Stt(y; + y;+2) - (i - ^1^)^%. 



-Bi\B 



tt\-i 



(1 + a^)Ys - a{Ys-i + F.+i) - (1 - 
(1 + a')Ys+i - aiVs + n+2) - (1 - 



■(1 + (Stt)2)y^ _ att(y^_^ + K,^^) _ (1 _ «tt)^ 
(1 + {amYs+, - al^iVs + n+2) - (1 - 

(1 + a^)Ys - a{Ys-i + Ys+i) - (1 - a)fi, 
(1 + _ a{Y, + ^+2) - (1 - 



tt 

tt 
e.n 



(1 + _ + y^^^) _ (1 _ 

(1 + a^)Ys+i - a(n + F,+2) - (1 - 



[a 



tt 
;tt 



a)n - + n+i) + a - 1 



(Stt + a)Ys+i - (n + F,+2) + a - 1 



al"^ — a 
Pel - f^s 



+ y^(5tt)-i(5tt_5tt)(5tt)-i 



(1 + a^)Ys - a{Ys^i + - (1 - 
(1 + - a{Y, + Ys+2) - (1 - 
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Hence 
(3.7.12) 



tt _ 



a] 



holds asymptotically as n — )• oo with probability one, where 



tt^-i 



tt 



a)Y, - y,_i - n+i + yuj,; a - 1 



-r;^tt 
1 



;i + a2)y^_a(y;_i + y;+i)-(i-a)/i, o 



'l + a'')Y,+i~a{Ys + Y,+2) 



(5tt)-i 

By fl3.7.3p and fl3.7.4p . we have Dn,a,e converges almost surely as n — )■ oo to 

(i?tt)-i 



2aYs+i -Ys- Ys+2 + fJ's a - 1 



+ (fitt)-i 



-2a 1 
1 -2a 



(5tt)-i 



:i + - + F.+i) - (1 - a)fi, 

:i + a^)^,^, _ aiYs + Ys+2) - (1 - 



Hence, by f l3.7.12p . (13.7.101) and Slutsky's lemma, we have (I3.7.1ip . 



□ 



4 The INAR(l) model with innovational out hers 
4.1 The model and some preliminaries 

In this section we introduce INAR(l) models contaminated with innovational outliers and we 
also give some preliminaries. 

4.1.1 Definition. Let (£^)£eN be an i.i.d. sequence of non-negative integer-valued random 
variables. A stochastic process {Yk)k&z+ is called an INAR(l) model with finitely many inno- 
vational outliers if 

Yk-i 

i=i 

where for all k E N, {^k,j)jen is a sequence of i.i.d. Bernoulli random variables with mean 
a G (0, 1) such that these sequences are mutually independent and independent of the sequence 
{ee)een, and Yq is a non-negative integer-valued random variable independent of the sequences 
(6,i)jeN, k eN, and (5£)£eN, and 

I 

Vk := ^fc + X] h,sAy k e z+, 

where / G N and Si, 9i E N, i = 1, . . . , I . We assume that EYq < oo and that Eef < oo, 
P{e, ^ 0) > 0. 
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In case of one (innovational) outlier a more suitable representation of Y is given in the 
following proposition. 



4.1.1 Proposition. Let he an INAR(l) model with one innovational outlier 6i := 6 

at time point Si := s. Then for all u & Q and k G Z+, Yk{uj) = Xk{uj) + Zk{u)), where 
is an INAR(l) model given by 

Xk := ^ + ken, 

with Xq ■=Yq, and 

fo tf A; = 0,l,...,s-1, 

(4.1.1) Zk:=\e tf k = s, 

iEf=xSre.,, tf k^s + l. 

Moreover, the processes X and Z are independent, and P(limfc_5.oo 2'^ = 0) = 1 and 
Zk — ^ as /c — > oo for all p G N, where — ^ denotes convergence in Lp. 

Proof. Clearly, Yj = Xj + Zj for j = 0, 1, . . . , s — 1, and 

= ^^'j' + ^^ = Y1 ^^'j' + £s + o = Xs + e = Xs + Zs, 

i=i i=i i=i i=x»+i 

By induction, we easily conclude that Yk{uj) = Xk{u) + Zk{oj) for all u E Q and A; G Z+. 

In proving the independence of the processes X and Z, it is enough to check that the 
conditions of Lemma \572\ (see Appendix) are satisfied. For all n > s, in-i,in, jn-i, jn ^ ^+ 
and for all B G cr[C,i,j '■ i = 1, ... ,n — 2, j G N) with the property that the event A : = 
{Xn-i = in-i, Zn-i = jn-i} H B has positivc probability, we get 

(in-l in-l+jn-1 
j=l j=i„-i + l 

(4.1.2) 

(in-l \ / in-l+jn-1 

J = l / \j = in-l+l 

where we used the measurability of (X„_i,Z„_i) with respect to the a-algebra cr{^i,j '■ 
i = l,...,n — 1, j G N) and that the random variables e„, (^n,i, • • • , ^n,i„_i) and 
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{^n,i„-i+i, • • • ) ^n,i„_i+j„_i) are independent of this a-algebra and also from each other. Hence, 
for all n > s, 

(4.1.3) P(X„ = in, Zn = jn \ A) = P(X„ = i„, Zn = jn \ = «n-l, Z^-l = jn-l)- 

Since Zq = Zi = ■ ■ ■ = Zg-i = 0, Zg = 0, and {Xn)nez+ is a Markov chain, we have fl4.1.3p 
is satisfied also for n = 1,2, . . . , s, which yields that (X„, Zn)nez+ is a Markov chain. Since 
Zq = 0, Xq and Zq are independent. Similar arguments along with the result in fl4.1.2p . with 
the special choice B := Q lead to 

P(^n ^n; Z^ - 




— Jn-1 



— P(-^n — in I — '^n-l)P(^n — Jn | — jn~l), 

which yields that the conditions of Lemma 15.21 are satisfied. 
Since 

Zk+1 = ^ ^k+i,j ^ ^ 1 = ^fc, s, 

j=Xk + l j=Xk+l 

the sequence {Zk{ijj))k^s+i is monotone decreasing for all co & Q. Using the fact that ^ 0, 
k E N, we have {Zk{u))ki^z+ converges for all u E Q. Hence, if we check that Z^ converges 
in probability to as k ^ oo, then, by Riesz's theorem, we get P(limfc_j.oo = 0) = 1. Let 
' be the cx-algebra generated by the random variables Xq, Xi, . . . , X^ and Zq, Zi, . . . , Z^. 
Using that E(Zfc | J^^_lf) = aZ^-i, k ^ s + 1, we get EZk = aEZ^-i, k ^ s + 1, and hence 
EZg^k = Oi'^EZg = 9a^ , k ^ 0. For all e > 0, by Markov's inequality, 

P(Z,+fc ^e)^ =^ = — ^ as A; ^ oo, 

6 € 

as desired. We note that the fact that P(limfc^oo Z^ = 0) = 1 is in accordance with Theorem 
2 in Chapter I in Athreya and Ney [8]. 

Since the sequence {Zk{ijj))k^s+i is monotone decreasing for all co E Q, we get for all p G N 
and for any constant M > 0, the sequence (|-^fc|^l{|Zfc|^M});j>^^^ is monotone decreasing. 
Hence 



sup E {\Zk\^l{\Zk\^M}) = E {\Zs+i\'^l{\z,+,\;,M}) ^0 as M oo 



which yields the uniformly integrability of (Z^)fcgN- By Lemma 15.31 (see Appendix), we 
conclude that — ^ as k oo, i.e., limfc_>oo EZ^ = 0. □ 

For our later purposes we need the following lemma about the explicit forms of the first and 
second moments of the process Z. 

4.1.1 Lemma. We have 

k G Z+, 



(4.1.4) 


EZg+k - 




(4.1.5) 


^zl, - 




(4.1.6) 


E(^s+fc- 


-iZg+k) 



Oa'^ia'' - 1), ke Z+, 

aEZ^^^^_^ = e^a^^-^ - ea^{a^~^ - 1), ke N. 
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Proof. Recall that ' denotes the a-algebra generated by the random variables 
Xq, Xi, . . . , Xfc and Zq, Zi, . . . , Z^. Using that E(Zfc | J-'^_li) = ct^fc-i, A; ^ s + 1, we 
get EZk = aEZk-i, k ^ s + 1, and hence EZ^+fc = a'^EZg = 9a'^, k G Z_|_. Since a G (0, 1), 
we have limfc_j>oo EZ^ = 0. Moreover, using that 



(4.1.7) 

E{{Z,-aZ,_,r\J^^f] 



we get 




A; ^ s + 1, 



E(Z2 I ) = E(((Zfe - aZk-i) + aZfc-i)' | = a{l - a)Zk-i + a^Zl_^, k ^ s + 1, 



and hence EZ| = a^EZ|_^ 


+ a( 


1 - a)EZk-u 


^ s + 1 




"ez; 




a 




EZfc_i 




EZ,2. 




a{l — a) 




.E^Li. 



A; ^ s + 1, 



and hence, by an easy calculation, for all A; ^ 0, 



(1 - 

^^a^'^ - ^a'=(a'= - 1) 
Finally, for all A; G N, 

E{Zs+k-lZs+k) = ^{^{Zs+k~lZs+k\ J^s+k-l)) = ^{Zs+k~lE{Zs+k\ J^s+k-l)) = ^{Zs+k-l(^Zs+k-l) 

= aEZl^f^_]^, 

which yields (gXe]). □ 

In case of two (innovational) outliers a similar representation of Y is given in the following 
proposition. 

4.1.2 Proposition. Let {Yk)k&+ be an INAR(l) model with two innovational outliers 9i 
and 02 at time points si and S2, si < S2, 

Yk-i 

yk=Yl + Vk, ke N, 

where for all A; G N, {^k,j)jm is a sequence of i.i.d. Bernoulli random variables with mean 
a G (0, 1) such that these sequences are mutually independent and independent of the sequence 
ond Yq is a non-negative integer-valued random variable independent of the sequences 
{ik,j)j&h keN, and (£:^)^eN, and rjk := Ek + Sk,sidi + ^,32^2, A; G Z+. Then for all wGfi 





"ez; 






_^zl 





a 



a 





' e' 




9\ 
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and k eZ+, Yk{uj) = Xk{uj) + zl^\uj) + zi^\u), where [X^) k&+ is an INAR(l) model 
given by 

with Xq := Yq, and 

if /c = 0, 1, . . . ,si - 1, 
(4.1.8) Zl'^ ■.= {6^ zf k = s,, 




■kXu^i -\~Z 



(1) 



and 



(4.1.9) Z, 



(2) 

k 



z/ fc = 0,l,...,S2-l, 

Y 4-7(1' „(2) 
^ J-Afc_i+Zj._^-^ + l 



Moreover, the processes X, and are (pairwise) independent, and P {\imk~^oo Zj^ = 

0) = 1, i = l, 2, and zf ^0 as k oo for all peN, i = l,2. 

Proof. The proof is the very same as the proof of Proposition I4.1.1[ We only note that the 
independence of Z^^'^ and Z^'^'^ follows by the definitions of the processes Z^^^ and Z^'^\ □ 

In the sequel we denote by J^^ the a-algebra generated by the random variables 
Yo,Yi, . . . ,Yk. For all n G N, yo, . . . ,yn E M. and uj E fl, let us introduce the nota- 
tions 

Y„(w) := {Yo{u),Yi{u), . . . ,F„(u;)), Y„ := {Yo,Yi, . . . ,F„), y„ := {yo,yi, ■ ■ .,?/„). 

4.2 One outlier, estimation of the mean of the offspring distribution 
and the outher's size 

First we suppose that 1 = 1 and that Si := s is known. We concentrate on the CLS 
estimation of the parameter {a, 6), where 6 := 6i. An easy calculation shows that 

(4.2.1) E(n I J^I-i) = aYu-i + ^Vk = a^-i + /x. + ^ ^ N. 

Hence for n s, n G N, 

n 

Y.i^k-m\j^l,)Y 

k=l 

(4.2.2) 



n 



k=l 
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For all n ^ s, n E N, we define the function Qn : M"+i X ^ M, as 

n 

QniYn, a', 0') ■= ^ [Vk - a'Vk-i - Ate)^ + {Vs - a'Vs^i - l^e - O'Y, 

k=l 

for all y„ G M"^^ and a' , 6' G M. By definition, for all n ^ s, a CLS estimator for the 
parameter (a, 9) G (0, 1) x N is a measurable function (5„, 6'„) : — )■ such that 

Qniyn, an{y n), Onijn)) = inf (Y™; 6*') V y„ G ^n, 

(a',6»')eM2 

where Sn is suitable subset of M"+^ (defined in the proof of Lemma [4.2 .11) . We note that we 
do not define the CLS estimator {an, On) for all samples y„ G R""'"^ We have 

n 

— -^(y„;a',6'') = -2 ^ [Vk - a'Vk-i - ^■e)yk-i - '^{Vs - a'Vs-i - ^-e - 0')ys-i, 

k=l 

The next lemma is about the existence and uniqueness of the CLS estimator of (a, 6). 
4.2.1 Lemma. There exist subsets Sn C M"'''^, n ^ max(3, wi/i the following properties: 

(i) i/iere exzsfo a unique CLS estimator (5„, 6'„) : Sn — )■ M^, 

(ii) for all y„ G 5"^, the system of equations 

(4.2.3) ^(y„; a', = 0, ^(y„; = 0, 



has the unique solution 



\yk - fJ'e)yk~i 



(4.2.4) 5„(y„) = ^ 



fc=i 



yk-1 



(4.2.5) 6'„(y„) = - an(yn)z/s-i - /ie, 

(iii) Y„ G Sn holds asymptotically as n oo wz^/i probability one. 
Proof. One can easily check that the unique solution of the system of equations (I4.2.3P takes 

n 

the form ( I4.2.4P and (14.2. 5p whenever yl_i > 0. 

k=i 

Next we prove that the function 3 {a', 9') i— > Qn{yn]o:',9') is strictly convex for all 
y„ G 5"^, where 



Sn := < yn e 



pn+l 



n N 

fc=l J 
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For this it is enough to check that the (2 x 2)-matrix 



Hniyn;oi',9') :-- 



d{a')^ dO'da' 



(y„; a', 9') 



is (strictly) positive definite for all y„ G Sn, see, e.g., Berkovitz [TO', Theorem 3.3, Chapter 
III]. For all y„ G M"+^ and {a', 9') e R^, 



^(y„; 9') = 2 J^''' yU + ^vU = 2 E vl,, 



d{a' 
d'Qn 



k=l 



d^Qn 



k=l 



d^Qn 



^^^{yn,a',9')=2. 
Then Hnijn] a', 9') has leading principal minors 



2$^2/Li and 4^^'^y2_i 



fc=i 



fc=i 



which are positive for all y„ G S'„. Hence Hn{yn]Oi' ,9') is (strictly) positive definite for all 

Since the function 3 {oi',9') ^ Qniyn',C(',9') is strictly convex for all y„ G S'„ and 
the system of equations (I4.2.3P has a unique solution for all y„ G we get the function in 
question attains its (global) minimum at this unique solution, which yields (i) and (ii). 

Next we check that Y„ G Sn holds asymptotically as n — > oo with probability one. By 
Proposition I4.1.H we get 

n n n n 

k=l k=l k=l k=l 

Using again Proposition 14 . 1 . 11 and fl2.2.6p . we have 



V k=l J 



By Cauchy-Schwartz's inequality. 



\ k=\ J 



1. 



1 

n 



fe=s+l 

and hence 



n n 



fe=s+l 



fc=s+l 



\ 



1 " 

lim - y = 0, 



fe=s+l 



(4.2.6) 



pflim -V^'^Xfc_iZfc_i = 0^ 

\ fc=l / 
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Then 



which imphes that 

P| \\mJ2Yk-i = ^] =1- 



n~^oo ■ 

k=l 



Hence Y„ G Sn holds asymptotically as n — )■ oo with probability one. □ 

By Lemma [4.2.11 (5„(Y„), 6'„(Y„)) exists uniquely asymptotically as n — )■ oo with 
probability one. In the sequel we will simply denote it by (5„, ^„). 

The next result shows that 5„ is a strongly consistent estimator of a, whereas On fails 
to be a strongly consistent estimator of 9. 

4.2.1 Theorem. Consider the CLS estimators {an,0n)n& of the parameter (a,^)G(0,l)x 
N. The sequence (5„)„gN is strongly consistent for all (a, 6*) G (0, 1) x N, i.e., 

(4.2.7) P( lim 5„ = a) = 1, V (a, G (0, 1) x N, 

71— >00 

whereas the sequence {On)nm is not strongly consistent for any (a, 9) G (0, 1) x N, namely, 

(4.2.8) P ( lim en = Y,- - /i,) =1, V (a, ^) G (0, 1) x N. 

Proof. By (14.2.41) and Proposition 14. 1. 1"1 we have asymptotically as n — )■ oo with probability 
one, 

n 



a. 



k=l 



k=l 



k=l k=s+l k=s+l k=s+l 

" ^ ^ n n 



k=s+l 



By (I2.2.2p . to prove (I4.2.7p . it is enough to check that 
(4.2.9) 

p A -(X^ - lle)Xs-l + I]Ls+l(-^fc ~ l^e)Zk-l + ZLs+1 -^fc-l^fc + Y2=s+1 Zk~\Zk ^ g \ 



-s-oo n 
and 

(4.2.10) P f lim -^^'-1 + 2 ^^=^+1 ^^-^^^-^ + ^1-1 ^ 
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By Proposition 14.1.11 and Cauchy-Schwartz's inequality, we have 

P I lim - V Zl_^ = I = P I lim - V Zk-iZu = | = 1. 

\ k=s+l / \ fc=s+l / 

Hence, using also KTM . we get f l4X9l) and ( 14.2.101) . By fl4X5l) and gXTj), we get f liXSl) . □ 
The asymptotic distribution of the CLS estimation is given in the next theorem. 

4.2.2 Theorem. Under the additional assumptions EYq < oo and Eef < oc, we have 

(4.2.11) i/n(5„ - a) A/'(0, J as n ^ oo, 

where o"^ ^ is defined in fl2.2.9p . Moreover, conditionally on the value Yg^i, 

(4.2.12) ^/E(en - lim dk) ^ ^fiO, Y^_^al J as n ^ oo. 

fc^oo 

Proof. By <^7L^, we have 

n 

~ _ _ k=l 

k=l 

holds asymptotically as n — )■ oo with probability one. For all n ^ s + 1, by Proposition 
14.1.11 we have 

n 

(Yk - oYk^i - fie)yk-i 

k=l 

n 

r -1 

[{Xk - aXk-1 - fie) + {Zk - aZk-i)\ {Xk-i + Zk-i) 

k=l 

^ ^ n n 

= ^ {Xk - aXk-i - fie)Xk-i + ^ {Xk - aXk-i - /ie)Zfe_i + ^ (Zk - aZk-i)Xk-i 

k=l k=s+l k=s+l 

n 

+ i^k- aZk^i)Zk-i, 

k=s+l 

and 

TL n ^ 71 

k=l k=l k=s+l k=s+l 

By fl2XT|) and dMJ]), we have 

n 

^(Xfc - aXk-1 - fie)Xk-i 

(4.2.13) ^A/'(0,(t2 J n^oo. 

fc=i 
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In what follows we show that 



1 " 

(4.2.14) -= V (Xfc - aXk-i - fie)Zk-i ^ as n ^ oo, 

(4.2.15) —= (Zfc - aZfc_i)Xfc_i as n oo, 

^ k=s+\ 
1 " L 

(4.2.16) (Zfc - aZfc_i)Zfc_i ^ as n oo, 



n 

k=s+\ 



( 1 " 

(4.2.17) P hm - V Xfe_iZfe_i 

\ n— >oo n 
\ fc=s+l 

(4.2.18) P( hm i ^Li = 0) 

\ fc=s+l / 



=1, 



where — ^ denotes convergence in L\. We recall that if {rin)n&i is a sequence of square 
integrable random variables such that lim„_>.oo Er^^ = and lim„^oo E?]^ = 0, then ?7„ 
converges in L2 and hence in Li to as n — )■ 00. Hence to prove (14.2. 14p it is enough to 
check that 

1 " 

(4.2.19) lim — V E[(Xfc - aX^.i - /i,)Zfc_i] = 0, 

^ fc=s+l 
/ n 

(4.2.20) lim -E V (X^ - aXfc_i - /i,)Z, 

n^oo 77, \ ^ — ^ 
\fc=s+l 



Since EX^. = aEX^.i + /^e, A; G N, and the processes X and Z are independent, we have 
( I4.2.19p . Similarly, we get 

El ^ (Xfc - aXfc_i - /ie)^fe-i j = ^ E(Xfc - aXfc_i - /iJ^EZ^.^, n ^ s + 1. 

\fe=s+l / fc=s+l 

By ( I3XT4D , 

E(Xfc - aXfc_i - = a^{\ - a)EXo + a(l - a^~^)^^ + a^, G M, 

and then 

lim E(Xfc — aXfc_i — /i^)^ = lim [o^iX — a)EXo + a(l — ol^^^)^^ + cr^) = ol[i^ + cr^. 



Hence there exists some L > such that E(Xfc — aXfc_i — /i^)^ < L for all G N. By 
Proposition I4.1.H limfc_j.oo EZ| = 0, and hence lim„_j.oo ;^ ^^=1 EZ^ = 0, which yields that 

1 " L ^ 

- E(X, - aXk-i - f^e?EZl_, ^-Yl E^fc-i ^0 as n ^ 00. 

A;=s+1 fc=s+l 
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To prove (I4.2.15p . it is enough to check that 

1 " 

(4.2.21) hm V E[(Z, - aZ,_i)X,_i] = 

(4.2.22) hm -E ( V (Z^ - aZfc_i)Xfc_i ) = 

\fc=s+l / 



Since EZ^ = aEZfc_i, k ^ s + 1, and the processes X and Z are independent, we have 
(I4.2.21|) . Similarly, we get 

k=s+l / k=s+l 

Using that limfc^oo EX| = EX^ (see, fl2.1.2p and (12.2.41) ). there exists some L > such that 
EX| < L for all k e N. By Proposition SXH hm^^^o H^k - CiZ^-xf ^ limfc_^oo 2E(Z| + 
o?Z'l_^ = 0, and hence lim^^oo ^ '121=1 ^i^k — a^fc-i)^ = 0, which yields that 

1 " Zy " 

- y E{Zk - aZk-if£Xl_^ ^-Y HZk - aZk-if ^0 as n ^ oo. 

k=s+l k=s+l 

To prove (I4.2.16p . it is enough to check that 

1 " 

(4.2.23) lim — V £[{Zk - aZk-i)Zk-i] = 0, 

^ A:=s+1 

(4.2.24) lim -E f V {Z, - aZk.i)Z,^^^ 

\fc=s+l / 



2 

= 0. 



Using that E[iZk - aZfc_i)Zfe_i] = E(Zfc_iE(Zfc - aZ^-i \ Zk-i)) = 0, A; e N, we get (l4X23ll . 
For all k> I, k,i eN, we get 

E[{Zk - aZfc_i)Zfe_i(Z£ - «Z^_i)Z^_i] = E[E[(Za: - aZk-i)Zk-i{Ze - «Z^_i)Z^_i | jf.J] 

= E[Zfc_i(Z£ - aZe-i)Ze-iE{Zk - aZt-i \ J^k-i)] = 0> 

and hence, by (I4.1.7p . we obtain 

k=s+l J fc=s+l 

1 " 

= - E ^{ZUE{{Z,-aZ,.,f\7t.)\ 

fc=s+l 

n ^ — ^ n ^ — ^ 

A:=s+1 A;=s+1 
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By Proposition 14. 1. ll this implies (I4.2.24p . Condition ( I4.2.17P was already proved, see (I4.2.6p . 
Finally, Proposition SXH easily yields (14.2. Isp . Using ( 14.2. 13|) - (14.2. 18|) . Slutsky's lemma 
yields dOlT]) . 

By (IT2311 and g2SD, 

^{Qn - "^^^^^ = Vn{^n - (Xs - aYs-i - fJ'e)) = -v^(S„ - 

holds asymptotically as n — oo with probability one, and hence by (14.2. lip , we get (14.2. 12p . 
□ 

4.2.1 Remark. By (HXip and (13.2. 13p . 

^ (a'EYo + fie^ if fc = l,...,s-l, 

[a'^EYo + Oa^-' + if s. 

Hence E(r, - aYs-i - fie) =0, 9 e N. Moreover, by (13.2.14!) . 

Var(F^ - aF^-i - lie) = Var(X^ - aX^-i - fie + 0) = Var(Xs - - fie) 

= a'{l - a)EXo + 0/2^(1 - a"*"^) + 
= a''(l - a)EYo + afiei^ - a'^^) + <yl- 

If /c ^ s + 1, then one can derive a more complicated formula for Var(Yfc — oYk-i — f^e) 
containing the moments of Z, too. 

We also check that 6n is an asymptotically unbiased estimator of 6 as n — t- oo for all 
{a, 9) G (0, 1) X N. By (14.2.81) . the sequence On — 0, n G N, converges with probability one 
and hence bounded with probability one, and then the dominated convergence theorem yields 
that lim^^oo EiJ)^ - 6*) = 0. □ 



4.3 One outlier, estimation of the mean of the offspring and inno- 
vation distributions and the outUer's size 

We suppose that 1 = 1 and that si := s is known. We concentrate on the CLS estimation of 
(a,/ie,6'), where 6 := 6i. Motivated by (I4.2.2p . for all n ^ s, n G N, we define the function 

Qn : M"+^ X R3 ^ M, as 

n 

Qn{yn;a',fJ''e,d') ■= ^ [Vk - Ot' Vk-l ~ f^^'eY + {v s - Ot' V s~l ^ fj'e ~ ^'Y , 
k=l 

for all G M"+^ and a',fi'^,6' G M. By definition, for all n ^ s, a CLS estimator for the 
parameter (a,/ie,6') G (0, 1) x (0, oo) x N is a measurable function {an,%,n,0n) : 5'„ — )■ 
such that 

Qn{yn;an{yn),%,n{yn),0n{yn))= inf Q„(y„; , /i'^, 6*') V y„ G S'„, 
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where Sn is suitable subset of M""^^ (defined in the proof of Lemma [4.3 .ip . We note that we 

do not define the CLS estimator (Sn, /^£^„, for all samples y„ G M""*"^. We get 

n 

-^(y„;a',/i^,6'') = -2 ^ {vk - a'Vk-i - l^'e)yk-i - 2(y, - a'vs^i - 1^'^ - d')ys-i, 

k=l 
n 

y{yn]a\lj!e^O') = [Vk - a'vk-i - /iQ -2{ys- a'vs-i - /^^ - 6*'), 



k=l 

dQ 



The next lemma is about the existence and uniqueness of the CLS estimator of {a,fis 
4.3.1 Lemma. There exist subsets Sn C M""*""^, s with the following properties: 

(i) there exists a unique CLS estimator (a„, 6'„) : Sn — > M'^, 

(ii) for all y„ G Sn, the system of equations 

-^(y„;a,/i^,^) = 0, 
(4.3.1) ^(y„;a',/i'„^^0 = O, 



has the unique solution 



(4.3.2) a„(y„) 



-^(y„;a,/i^,^) = 0, 



(n - 1) 2^ yk-m - Vk}^ Vk-i 

k=l k=l k=l 



(4.3.3) %,n{yr 



DniYn) 



2 v^v*v v^'^'*-' \^(*) 

Vk-i 2^ Vk - 2^ yk'iz^ Vk-Wk 

k=l k=l k=l k=l 



Dniyr 

(4.3.4) On{yn) =ys- an{yn)ys-l - %,n{yn) 



where 



k=l \ k=l 



2 

yk-1 , s, 



(iii) Y„ G Sn holds asymptotically as n — oo with probability one. 



Proof. One can easily check that the unique solution of the system of equations (14.3. ip takes 
the form ^X^-(^X3^-^X§ whenever Dn{yn) > 0. 
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For all n ^ s + 1, let 

Sn := {y„ e : A.(y„) > 0, A,,„(y„;a',/i;,0') > 0, z = 1,2,3, ^ (a', fi'^,e') G R^'} , 

where Aj „(y„; a', /i^, 9'), i = 1, 2, 3, denotes the i-th order leading principal minor of the 3x3 
matrix 



if„(y„;a',/i^,6'" 





d^Qn 


d^Qn 




dfj.'^ da' 


dO'da' 








da'dfj,'^ 






a^Qn 


d^Qn 


a^Q,^ 



,da'ae' a^i'^ae' d{e')'^ _ 

Then the function 3 {a', /i^, 9') i— )■ Qniyn', /^e, 9') is strictly convex for all y„ G Sn, see, 
e.g., Berkovitz pUl, Theorem 3.3, Chapter III]. 

Since the function 3 {a', ^'^,9') Qniyn]o:',fi'^,9') is strictly convex for all y„ G 
and the system of equations (14.3.11) has a unique solution for all y„ G S^, we get the function 
in question attains its (global) minimum at this unique solution, which yields (i) and (ii). 

Further, for all y„ G M"+^ and {a',fi'^,9') G M^, we have 



da'd9' 



^(y„; a, /i^, e') = 2 ^ yl^^ + 2yl_^ = 2 l/Li, 



k=l 



k=l 



— (y„; a , /x^, ^') = ggig^iYn; a,fi,,9) = 2ys-i 



and 



— -(y„;«,/i„^) = — — (y„;«,/x,,^) = 22^yfc_i. 



da'dfi'. 

d9'dfi^ 
d^Qn 



^(y„;a,/i„^) = ^-^(y„; « , ^ ) = 2, 



k=l 



Then Hn{yn] /^g, 6'') has the following leading principal minors 



Ai,„(y„; a', fx'^, ^') = 2 ^ yl_^, A2,„(y„; a', /x^, ^') = 4 | ^ - [ ^ 



fc=l 



A;=l 



and 



A3,n(yn; 9') = detiJ„(y„;a',/i^,6'') 

n n 

(n - 1) ^ + 21^.-1 yk-i - n{ys-if - ( ^fe-i 



fc=i 



vfc=l 



Note that Aj^„(y„; a', /i'^, 6''), i = 1,2,3, do not depend on {a', fi'^,9'), and hence we will 
simply denote Ai_„(y„; a', /x^, 6*') by Ai,„(y„). 
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Next we check that Y„ G Sn holds asymptotically as n — )■ cxd with probability one. By 
( I2.2.5P and fl2.2.6p . using the very same arguments as in the proof of Lemma [4.2.11 one can get 

p ( lim ^^'"^^"^ = 2EX' 

71— >CXD Jl 

pl lim ^^dXA = 4ys^rX] =1, 
p( lim ^^l!il = 8VarX 

where X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in f l2.1.ip . Hence 



P ( lim A,,„(Y„) = oo) = 1, 

\n— >oo / 

By f l2X5|) and (JMH), we also get 



i = 1,2,3. 



(4.3.5) P ( lim MIA = VarX ) = 1 



and hence P(lim„_j.oo -D„(Yn) = oo) = 1. □ 

By Lemma 14.3.11 (a„(Y„), /i£^„(Y„), 6'„(Y„)) exists uniquely asymptotically as n ^ oo 
with probability one. In the sequel we will simply denote it by (a„, 6'„), we will also 
denote -D„(Y„) by 

By ^X2l and fl4X3D . we also get 



(n n \ 

k=l k=l / 



h — 

holds asymptotically as n — )■ oo with probability one. 

The next result shows that a„ and ^e,n are strongly consistent estimators of a and /i^, 
whereas On fails to be a strongly consistent estimator of 9. 

4.3.1 Theorem. Consider the CLS estimators {an-,^e,niOn)n&i of the parameter {a, fie, 6) E 
(0, 1) X (0, oo) X N. The sequences {an)n£n cind (/i£,n)neN are strongly consistent for all 
(a,/ie,6') e (0, 1) X (0, oo) X N, i.e., 

(4.3.6) P( lim a„ = a) = 1, V (a, /i^, ^) G (0, 1) x (0, oo) x N, 

n—>OD 

(4.3.7) P( lim = /i,) = 1, V(a,/x„^) G (0,1) X (0,oo) X N, 

n—^oo 

whereas the sequence {6n)nm is not strongly consistent for any (a, /i^, 6) G (0, 1) x (0, oo) x N, 
namely, 

(4.3.8) P (lim On = Y,-aY,.,- fie) = 1, V (a, /i„ ^) G (0, 1) x (0, oo) x N. 
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Proof. By (KT2^ . (14X31) and Proposition gXH we get 





1 




f^e,n 




Ln 



where 



k=l 



k=l 



k=l 

n 



k=l k=l k=l k=l 

Using the very same arguments as in the proof of Theorem I4.2.H we obtain 

P f hm = aEX^ + fi.EX - {EX)A = 1, 

P ( hm =1 = EX^EX - EX(aEX2 + fieEX)] = 1. 



By and fl^X^ . ([M3D, we obtain 



, ^ aVarX + (a-l)(EX)2 + /i,EX 
P I lim an = lim — = = a 

n^oo n^oo Var X 



and 



P , ,. ^ i^n (l-a)EXEX^-/i,(EX)2 

P hm /Xe^ = hm — = = 

" -Dn Var X 



where we used that 

{I - a)EXEX'^ - li,{EXf 
VarX 



1 



VarX 



1 — a V 1 — 



VarX 

Finally, using flQIij) . (|43:6|) and ( HXTj) we get (031]). 

The asymptotic distribution of the CLS estimation is given in the next theorem. 

4.3.2 Theorem. Under the additional assumptions EYq < oo and Eef < oo, we have 



□ 



(4.3.9) 



^/n{an - a) 



1 Bq, e 



as n oo, 



where Ba^e is defined in f l2.3.2p . Moreover, conditionally on the value Yg-i, 

c 



(4.3.10) 



./EiOn - lim Ok) ^ A/'(0, 0]B^AYs-i 0] 

k—^oo 



as n — )■ oo. 
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Proof. By (KT2^ and we have 

n 



1 



(n 



k=l k=l k=l 

n n 



L A:=l k=l k=l k=l 

holds asymptotically as n — )■ cxd with probability one. By Proposition I4.1.H we get 



1 



(n 



n n n ■ 

fc=i fc=i fc=i 



fc=i 

L fc=i fc=i fc=i fc=i 

holds asymptotically as n — t- oo with probability one, where 

n n 

Rn :=(n - 1) Y!'''\Zu - aZ^,_^)[X^_^ + Z^_^) + (n - 1) Y^'\x^ - aXfc_i)Z,_i 



fe=i 



fc=i 



n n 71 n 

fc=l fc=l /c=l fc=l 



and 



fc=l fc=l k=\ k=\ 

n n n n 

Zk-i i-^k + Zk — /ie)(Xfc_i + Zk-i) — Xfc_i Zk{Xk-i + Zk-i) 



k=l 



k=l 



k=l 



k=l 



Xfc-1 {Xk — fis)Zk-i- 

k=l k=l 

By (I4.3.5p . (I2.3.ip and Slutsky's lemma, we have 

n 

n 



^(^) 



n 



(Xfc - Q;Xfc_i)Xfc_i - (Xfc - aXfc_i) Xk-i 

k=l k=l k=l 

n n n n 



L fc=l 



AT 



as n — )■ oo, and hence to prove fl4.3.9p . by fl4.3.5p and Slutsky's lemma, it is enough to check 
that 



(4.3.11) 

and 

(4.3.12) 



Rr 



n 



3/2 



Qr 



n 



3/2 



as n — )■ OO, 



as n — )■ oo. 
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p 

where — > denotes convergence in probability. By f l4.2.15p and f l4.2.16p . to prove f l4.3.1ip it 
remains to check that 

n 

1 V — v(*) P 

(4.3.13) ~1=A^ i^k- aXk_i)Zk-i — > as n cx), 
^ k=i 

n n 

(4.3.14) ^ V^'^^fc - «^fc-i) ■ - V^'\Xfc_i + Zfe„i) A as n^oo, 

^ k=l k=l 

n n 

(4.3.15) -y^'\Xk-aXk-i)-^y^'^ Zk^,-^0 as n oo. 

k=\ ^ k=l 

Using (14.2. 14p and that 

~1= y^!^ ~ oi^k-i)Zk-i = y^ - aXk-i - fie)Zk-i + fJ'£A= ^ Zk-1, 
Jn ^-^ Jn ^-^ Jn ^-^ 

^ k=i V k=i V k=i 

to prove (I4.3.13p . it is enough to check that 

n 

1 v-~v(*) P 

(4.3.16) —= y Z^-i — > as n — )■ oo. 

Jn ^-^ 

V k=i 



Using that ^ 0, k eN, by Markov's inequahty, it is enough to check that 

hm —= 

n-s>oo y/n ■ 



(4.3.17) hm ^ y EZk-i = 0. 



k=l 

k 



Since, by fHTij) . EZ^+fc = ^ 0, we have 

(4.3.18) J^y^'^ EZk-i ^ a' = -^ "^^ '^ ^0 as n ^ oo. 



Using that 

= EX = 1, 



(n 
hm - V (Xfc_i + Zk 
ra— s>oo 72 ' 
fc=l 



to prove (14.3. 14p it is enough to check that 

n 

(4.3.19) ^ y^^\Zk - aZk^i) ^ 



as n — )■ cxD. 



To verify (14.3. 19p it is enough to show that 

hm 

n-5-oo ^n 



n 

(4.3.20) hm ^ y^'^ E(Zfe - aZ^-i) = 0, 



(4.3.21) hm -E f V^'^Zfc - aZfc_i)) 



k=l 

2 

= 0. 
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Using that EZk = aEZk^i, k ^ s + 1, we get ( I4.3.20p is satisfied. Using that E[{Zk — 
aZk^i){Zi — aZi^i)] =0 for all k i, k,£ s + 1, we have 

2 



(n \ ^ n 

V^'^ (Z, - aZk-i) I = - V^'^ E(Zfe - ^ 

fc=l / k=l 

as we showed in the proof of Theorem I4.2.2[ Using that 



as n — )■ oo, 



(71 
1 Nr^(s) 
lim-V [Xk-aXk-i] 
n^oD fl ^ 
k=l 



;i-a)EXj =1, 



to prove (14.3. ISp it is enough to verify fl4.3.16p which was already done. 
Now we turn to prove (14.3.121) . Using (14.3. 16p and that 

P f lim - + Zk- fie) = EX - A = 1, 

P ( lim - + Zk- fie){Xk-i + Zk-i) = aEX^ + /i,EX - fx.EX = aExA = 1, 

V fc=i / 

it is enough to verify that 

n 

(4.3.22) ^ V^'^ Xk-iZk-i -^0 as n ^ oo, 

^ k=i 

n 

(4.3.23) ^ ^^'^ -^0 as n ^ oo, 



n 

k=l 



n 

(4.3.24) ^ V^'^ ^fc-i^fc ^0 as n ^ oo. 



n 

k=l 



To prove (I4.3.22p . using that the processes X and Z are non- negative, by Markov's inequality, 
it is enough to verify that 



lim ^V^'^E(Xfc_iZfc_i)=0. 

V fc=l 



Using that the processes X and Z are independent and limfc_j.oo EXfc_i = EX, as in the 
proof of (I4.2.15p . we get it is enough to check that 

n 

1 'ir^C'*) 
hm — > EZfc_i = 0, 

V fc=l 

which follows by (14.3. ISp . Similarly, to prove (I4.3.23p . it is enough to show that 



n 

lim^5:^^^EZt, = 0. 



^ k=l 
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By f l4.1.5p , we have for all n ^ s + 1, 



1 V-(^)r^9 ^ 1 ^,n2 2k nk, k . ^ ^2 ^2(n+l) _ ^ Q - 1 ^ 



k=l 



n 



k=0 



^Jn a"^ — 1 ^Jn a — 1 



as — )■ oo. Similarly, to prove (14.3 ■24p . it is enough to check that 

n 

lim ^ yj'^ E{Zk-,Zk) = 0. 

^ fc=l 



By fl4.1.6p , we have for all n ^ s + 1 , 



" n 



^2 - 1 ^ a" - 1 



as n — 7- oo. 

Finally, using f l4.3.4p and f l4.3.8p . we get 

y/n{9n - lim 9k) = -^/n{an - - ^/n{%^ri - fJ's 



a\/n a;2 — 1 A/n a — 1 



^0, 



-Ys-i -1 



v/ri(S„ - a) 
V^{%,n - Ate 



and hence, by ( I4.3.9p . we have (I4.3.10p 



□ 



4.4 Two outliers, estimation of the mean of the offspring distribu- 
tion and the outUers' sizes 

We assume that 1 = 2 and that the relevant time points Si, S2 G N, Si 7^ S2, are known. 
We concentrate on the CLS estimation of (a, 9i, 6*2). We have 

E{Yk I J'J.i) = aYk-i + /i, + 6k,sA + 6k,s,92, keN. 

Hence for all n ^ max(si, S2), 

n 



k=l 



n {si,S2) 



{Yk - oYk-l - He) + iYs^ - aYs^-i - fie- 9i) + (F^a - aYs2-i - j^e - 62) ■ 



k=l 



n . ^""^^ X R3 ^ M, as 



For all n ^ max(si, S2), n E N, we define the function Q 
Qniyn;a\9[,92) 

■=Y {Vk- a'Vk-l- fJ'e) + {ysi-a'ysi~l~ fJ'e-0'l) + (z/sa " "'Z/sa-l " /"e - ^2) ' 

k=l 
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for all Yn € M"^^, a' ,9'^, 62 G M. By definition, for all n ^ max(si,S2), a CLS estimator for 
the parameter (a, ^1, 6*2) G (0, 1) x is a measurable function (5„, ^2,n) : 5'„ — )• such 
that 

Qnijn] inf Qn{yn;a,0[,92) V y„ G S'„ 



where Sn is suitable subset of R""''^ (defined in the proof of Lemma [4.4. II) . We note that we 
do not define the CLS estimator (5„, 6'i^„, 6'2,n) for all samples y„ G R"^^ For all y„ G R"'"'"\ 

«',^i,^2eR, 



da 



k=l 



^^(y„;a',^;,^2) = -2(2/.2 - «'2/s2-i -/i^-^s). 

The next lemma is about the existence and uniqueness of the CLS estimator of {0,61,62). 

4.4.1 Lemma. There exist subsets Sn C R^^"*^, n ^ max(3,Si,S2) with the following proper- 
ties: 

(i) there exists a unique CLS estimator {an, 6'2,n) '■ Sn R^, 

(ii) for all y„, G the system of equations 

^^}{yn,a',6[,6',) = 0. 



da 

(4.4.1) ^{yn,a',6[,6',)=0, 

^^riyn;oi',6[,62) = 0, 



06, 



has the unique solution 



(4.4.2) an{yr, 



^ {Vk - lJ'e)yk-l 



k=l 



n («ii«2) 

53 yl-i 



k=l 

(4.4.3) ^i,n(yn) = 2/5, - an{yn)ysi-i - /^e, ^ = 1, 2, 



(iii) Y„ G S'n /ioWs asymptotically as n ^ oo with probability one. 



84 



Proof. One can easily check that the unique solution of the system of equations ( I4.4.ip takes 
the form f l4.4.2p and fl4.4.3p whenever ^ yl_^ > 0. 

k=l 

For all n ^ max(3, Si, S2), let 

:= {yn e M"+^ : A,,„(y„; a', e[, 6'^) > 0, z = 1, 2, 3, V {a', e[, 6',) G M^} , 

where Aj^„(y„; a', fi'^, 6'), i = 1, 2, 3, denotes the i-th order leading principal minor of the 3x3 
matrix 





r d^Qn 




92 Q„ 1 








de[da' 








da'de[ 


















Lda'd9!2 




a(e^)2 J 





Then the function 3 (a', 6'^, 6*2) 1— )■ Qn(yn; a', 6''^, 62) is strictly convex for all G S^, see, 
e.g., Berkovitz [TOl Theorem 3.3, Chapter III]. Further, for all y„ G M"+^ and (a', e[, O'^) G M^ 
we have 



^(y„; a', ^1, 9',) = 2 J]^"'"^ + 2yl_, + 2y,Vi = 2 



(9(a 



fc=i 

^2/ 



fc=l 



--(y„; a', 9'^) = j^^rT^{yn] ^'1, ^2) = 2l/s2-i, 



d9'2da' 

^(y.;«',^;,^^)^o. 



^(y„;a',0;,5^) = 2. 



d{9',) 



— (y„; a ,6'i,6l2) = 2. 



This yields that the system of equations (14.4.11) has a unique solution for all y„ G Sn,. Using 
also that the function 9 (a', 6*^, 6^2) 1— )■ Qri(y„; a', 6*^, 6*2) is strictly convex for all y^ G Sn, 
we get the function in question attains its (global) minimum at this unique solution, which 
yields (i) and (ii). 

Then if„(y„; a', 9'^, ^^2) has the following leading principal minors 

n / " 

Ai,„(y„;a',^i,^2) = 2^?/fc_i> A2,„(y„; a', ^i, ^2) = 4 ^vl-i - iVsr-i] 



k=l 



yk=l 



and 



A3,„(y„; a', 9[, 9',) = det ff„(y„; a', 9[, 9',) = 8 lj2 vl-i " iv. 



si-ij 



Note that Aj „(y„; a', ^^'j^, 6*2), i = 1,2,3, do not depend on {a\9[,9'^, and hence we will 
simply denote Ai_„(y„; a', 6''i, 6*2) by Ai_„(y„). 
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Next we check that Y„ G Sn holds asymptotically as n — )■ cxd with probability one. By 
( I2.2.5P and f l2.2.6p , using the very same arguments as in the proof of Lemma I4.2.H one can get 

p ( lim ^1:!^^ = = 1, 

\n^oo n J 

p ( lini ^Hi!^ = = 1, 

\n-^oo n J 

p ( lini = SEX^I = 1, 

where X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in f l2.1.ip . Hence 

Pf lim A,,„(Y„) = oo) = 1, ^ = 1,2,3, 



which yields that Y„ G Sn holds asymptotically as n — )■ oo with probability one. □ 

By Lemma 14.4. ![ (5„(Y„), 6'i^„(Y„), 6'2,„(Y„)) exists uniquely asymptotically as n — )■ oo 
with probability one. In the sequel we will simply denote it by 02,n)- 

The next result shows that 5^ is a strongly consistent estimator of a, whereas 9i^n, 
i = l,2, fail to be strongly consistent estimators of 6'j^„, i = 1,2, respectively. 

4.4.1 Theorem. Consider the CLS estimators {an,Oi,n,02,n)neN of the parameter [a, 61,62) G 
(0,l)xN^. The sequence (5„)„gN is strongly consistent for all (a, 6'i, 6*2) G (0, 1) x N^, i.e., 

(4.4.4) P( lim 5„ = a) = 1, V (a, ^1, ^2) G (0, 1) x N^ 

whereas the sequences {6i^n)n&i o-nd (^2,ri)neN are not strongly consistent for any {01,61,62) & 
(0, 1) X W , namely, 

(4.4.5) Pflim ^i,„ = F,^-aF,^_i-^,) =1, V (a, ^^i, ^^i) G (0, 1) x N^, i = l,2. 



Proof. By fl4.4.2p and Proposition 14.1.2^ we get 



(Xfc - /ie)Xfe_i + Kn 



~ k=l 

a 



n n 

isi,S2) 



k=l 



holds asymptotically as n — )■ 00 with probability one, where 



/C=l fc = l 

n 
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Using the very same arguments as in the proof of Theorem 14.2.11 one can obtain 



PI hm — = 1 = 1 



and P I hm — = 1 = 1. 

Indeed, the only fact that was not verified in the proof of Theorem 14.2.11 is that 

(4.4.6) 

By Cauchy-Schwartz's inequahty and Proposition 14.1.21 



(n 
hm - V 
k=l 



= 1=1. 



\ k=l 



(2). 



—7-0 as 72 — )■ oo, 



k=l 

with probabihty one. 

Finally, by ( HX3ll and fOIill . we have fHA5ll . 

4.4.1 Remark. Since 



fc=i 



- aYs2-i - fie 



— aXs2-i — /ie + 6*2 



and 



Cov(Xs^ - aXs-,-1 - fie + 01, - aXs^^l - yU^ + O2) 



by Remark 14.2.11 we get 

Ys^ - aYs^-i - fie 
- aYs2-i - fie 



Var 



a'^i(l - a)EYo + a/ie(l - a'^~^) + a 




The asymptotic distribution of the CLS estimation is given in the next theorem. 
4.4.2 Theorem. Under the additional assumptions EYq < 00 and Eef < 00, we have 
(4.4.7) y/n{an - a) J\f{0, a^J) as n 00, 

where a"^ ^ is defined in f l2.2.9p . Moreover, conditionally on the values Fsj-i and Yg^-i, 
(4.4.8) 



y/n{9i^n - linife^^oo 6'i,fc) 

y/n{92,n - hmfe_^oo d2,k) 



as n — )■ 00. 
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Proof. By fl4A2l) . we get 



n 



~ _ _ k=l 



k=l 



holds asymptotically as n — )■ oo with probability one. To prove fl4.4.7p . using Proposition 
iXland fl4.2.14h -f l4XT8l) . it is enough to check that 



as 77. — )■ oo, 



(4.4.9) ^E(^i"-«^i'i)^£^^0 

v'^ k=i 

(4.4.10) ^ - aZf_\)4_\ A as 77 oo. 

^ fc=i 

To prove (I4.4.9P it is enough to verify that 

1 " 

(4.4.11) hm — J2 E[(4'^ - = 0, 

V fc=l 

(4.4.12) Ito Ie - ' = 0. 

\fc=l / 

Since the processes and are independent, we have 

E[(Z« - aZl}},)zj^\] = E(Z« - «Z«JEZ£\ = 0, keN, 
which yields (14.4.111) . Using that for all k, i eN, k > i, 

E[(4'> - aZ<'_\)Zf_',(Zi'> - aZ<i\)Z;!\] = E[(4" - a4'_\)(Zf' - aZ^)] E(Zf_',Zf\; 

= E [(Zj" - aZ»',)E(4'> - aZ<'_\ | Tti)] E(C\zS) 
= . E(Z<1\4!\) = 0, 

we get 

fc=l / fc=l 



(1) ^2p^7(2) ^2 
/c=l 

^^Ee((4'V + «^(4-\)^)e(41)^. 

k=l 
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Hence, by f l4.1.5p . 



vfc=l 

2 



n 



E 

fc=0 



2 2 



+ 0'. 



+ Uo — 7. + at)'). — I — U as 72 — i- oo. 



a — 1 



a' - 1 



a — 1 



Similarly one can check (14.4. lOp . 

Moreover, conditionally on the values K^-i and Yg^-i, by fl4.4.3p . fl4.4.5p and f l4.4.7p . 



^/n{6i,n - limfc_^oo 6'i,fc) 

y/n{92,n - hnifc^oo 02,k) 



-{an - a)Ys^-i 
-(5„ - a)Ys2-i 



Ys^_iYs2-i 



Si 

Ys,-iY, 



V2 

Sl-l-fs2-l -'^82-1 



as n — > oo. 



□ 



4.5 Two outliers, estimation of the mean of the offspring and inno- 
vation distributions and the outUers' sizes 

We assume that 1 = 2 and that the relevant time points Si, S2 G N, Si 7^ S2, are known. 
We concentrate on the CLS estimation of (a, /Xg, 9i, 62)- We have 

E(n. I H-i) = OiYk-x + yu, + + 4,S2^2, A; e N. 

Hence for all n ^ max(si, S2), n G N, 

E(n-E(n|jT,))' 

fe=i 

n (si,S2) 

= ^ - aYk-\ - fXe) + {Ys-, - aYs,-i - Us - dl) + (^sa - "^S2-l - A^e - ^2) • 

k=l 

For all n ^ max(si, S2), G N, we define the function Qn '■ W^^^ x — > M, as 

Qniy-ni 

■= XI {Vk - a'vk-i - /iQ + {vs, - a'ys.^i - - ^'1) + {ys2 - ^Vs^-i - /^^ - ^2) , 
fc=i 
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for all y„ G M"^"*^, a', /x^, d'1,9'2 G M. By definition, for all n ^ max(si, S2), a CLS estimator for 
the parameter (a, /x^, ^1, ^2) ^ (0, 1) x (0, 00) x is a measurable function (q?„, /(ie,n, ^i,n, ^2,n) : 
Sn — such that 

= inf Qn{y n, a', IJ's, ^1,02) V y„ G S'„, 
(a',Aj^,6i;,e;,)eiR4 

where Sn is suitable subset of M"+^ (defined in the proof of Lemma [4.5. ip . We note that 
we do not define the CLS estimator {an,%,n,9i,n,92,n) for all samples y„ G W^^^. For all 
y„GM"+\a',/i;,^;,e^GM, 

k=l 

dQn " ^'"''^ 

fc=i 

-2(z/s2-a'l/s2-i-/^£-^2), 

^r(yn;«',/^£,^i>^2) = -2(i/s2 -a'ys2-i -/^^-^'s)- 

The next lemma is about the existence and uniqueness of the CLS estimator of (a, fj,^, 9i, 92). 
4.5.1 Lemma. There exist subsets C M""^"*^, n ^ max(si, S2) with the following properties: 

(i) there exists a unique CLS estimator {cin-,^e,n-,di,ni92,n) '■ Sn — )■ M"^, 

(ii) for all y„ G Sn, the system of equations 

^(y„;a',/i;,^;,^^) = 0, ^(y„; a', /i^, ^^^) = 0, 

(4.5.1) " 

-^(y„;a ,/i^,0i,^2) = 0, ^(y™; a , /i^, ^1, ^2) = 0, 
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has the unique solution 



(4.5.2) a„(y„) 



[n 



k=l 



k=l 



k=l 



Dn{yr, 



(4.5.3) 

(4.5.4) 

where 



%,n{yn) 



E[s\,S2) 2 ^-^(si.S2) ^-^(si,S2) ^-^(si,S2) 



k=l 



k=l 



k=l 



k=l 



Dniyr. 



Dn{yn) ■■= (n - 2) ^ ' yl_-^ ~ [Yl ' ^"-^ ) ' max(si, sa), 

k=l \ k=l / 

(iii) Y„, G Sn holds asymptotically as n ^ oo with probability one. 



Proof. One can easily check that the unique solution of the system of equations (14.5. ip takes 
the form (iS3)-(i33D-(lM3D whenever L'„(y„) > 0. 

For all n ^ max(si, S2), let 

Sn ■■= {yn G R"+i : DM > 0, \,niyn,a',fi'„e[,e',) > 0, 2 = 1,2,3,4, V(«',/i'„e;,0^) e M^} 

where Aj „(y„; a', /i^, 9[, O^), i = 1, 2, 3, 4, denotes the i-th order leading principal minor of the 
4x4 matrix 







d^Qn 


a^Q„ ' 




dfi'^da' 


de[da' 


ae'^da' 




d^Qn 




a^Qn 


da'dfi'^ 






ae'^dfi'^ 






a^Qn 


a^Qn 


da'de[ 






ae'2de[ 






a^Qn 


a^Qn 


_da'dei. 




ae[ae'2 


9(0^)2 J 



(y„;a',/i'^,0;,02 



Then the function 3 {a' , fi'^,9[,92) ^ Qniyn',C(', fJ^'£,9[,9'2) is strictly convex for all 
y„ G Sn, see, e.g., Berkovitz [ini Theorem 3.3, Chapter III]. 

Since the function 3 {a' , fi'^,9[,9'2) ^ Qniyn^oi' , n'^,9[,9'2) is strictly convex for all 
Yn G Sn and the system of equations fl4.5.ip has a unique solution for all G Sn, we get the 
function in question attains its (global) minimum at this unique solution, which yields (i) and 
(ii). 
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Further, for all G M"+^ and (a', /x^, ^i, G M^ 

^(y„; a', ^i, = 2 f:^"'"^ Z/L, + 2yU + 2z/.Vi = 2 E l/Li, 

^ ' A:=l k=l 



e 



fe=l 

^(y„; a , ^„ = ^(Yn; « , /x., 9,, 9,) = 2, 
^(y„; « , ^„ = ^(yn; a , ^„ 9,) = 2, 
^(y„; a , ^„ = ^(Yn; a , ^„ = 2y.,_„ 
|||(y„; a', 9[, 9',) = ||^(yn; /.^, ^i, = 2y.,_„ 



and 



d Qn / I I ai ai \ ^ / ' ' a' a' \ n 

Qg/gg/ (yn; « , ^1, ^2) = dgTogr'^y^'^ " ' ^1' ^2) = 0, 

^^(y„;a;,/x„^i,^2) = 2, ^^(y^; « , ^i, ^2) = 2- 
Then Hnijn] ct') A*£) ^2) ^^i® following leading principal minors 

n 

Ai,4y„-a',ii'„9[,9'2) = 2Y,yl-i, 



A2,„(yn; a', n'^, 9[, = 4 n J] yl_^ " I] ^fc 



fc=i 

2> 



k=l \k=l 



A3,„(yn; a', //e, 9[, = 8 (n - 1) ^ yl_^ - I Vk-i ) + 2y.i-i J2 ^^-i " ' 

y k=i \k=i / k=i J 

A4,n(yn; a', l^'s, 9'i, ^2) — det i/„(y„; a', 9[, 9'^). 

Note that Aj „(y„; a', /x^, 9[,92), i = 1, 2. 3, 4, do not depend on {a', /i'^, 9[, ^2), and hence we 
will simply denote Ai,„(y„; a', /x^, 6^^, 6^2) by Aj,„(y„). 

Next we check that Y„ e Sn holds asymptotically as n — >■ 00 with probability one. By 
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(I2.2.5P and (I2.2.6p . using the very same arguments as in the proof of Lemma [4.2. 11 one can get 

p ( lim ^idXA = 2EX'] = 1, 



pi lim ^ldXA=4y^rX] = 1, 



n— 5>oo fl^ 



p( lim ^3,n(Yn) ^8VarX 1 = 1, 



p( lim ^l4^ = 16VarXl = 1, 



where X denotes a random variable with the unique stationary distribution of the INAR(l) 
model in f l2.1.ip . Hence 



^ = 1,2,3,4. 



P f lim \n{Yn) = Oo) = 1 

\n—^oo / 

By (12:231) and fl2X6l) . we also get 

(4.5.5) P ( lim Rll^ = y^rx) = 1, 

\n^oo n J 

and hence P(lim„_>.oo -D„(Y„) = oo) = 1. □ 
By Lemma [4.5.11 

(a„(YO, /2.,„(Y„), ^i,„(YO, ^2,n(Y„) 

exists uniquely asymptotically as — t- oo with probability one. In the sequel we will simply 
denote it by {an,'fie,n,0i,n,d2,n), and we will also denote D„(Y„) by D„. 

The next result shows that a„ and are strongly consistent estimators of a and fie, 
respectively, whereas 9i^n, ^ = 1,2, fail to be strongly consistent estimators of 6'i,„, i = l,2, 
respectively. 

4.5.1 Theorem. Consider the CLS estimators {an,%,n,0i,n,0i,n)ne'M of the parameter 
(a, /ie, 6'i, ^^2) £ (0,1) X (0,00) X N^. The sequences (a„)„gfsj and (/ie,n)neN o'^e strongly 
consistent for all (a, yU^, 6'i, ^^2) G (0, 1) x (0, 00) x N^, i.e., 

(4.5.6) P( lim a„ = a) = 1, V (a, /x^, ^1, ^2) e (0, 1) x (0, 00) x N^, 

(4.5.7) P( lim = /X,) = 1, V(«,/i„^i,02) G (0,1) X (0,00) xN^, 

71— ^-OO 

whereas the sequences (6'i,n)neN '^'^'^ (6'2,n)neN not strongly consistent for any 

{a, /ie, 61, 62) G (0, 1) X (0, 00) X W, namely, 

(4.5.8) P ( lim = - - /i, 

\n— >oo 

for all (a,/Xe,6'i,6'2) G (0,1) X (0,cx)) X and i = l,2. 
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Proof. To prove (I4.5.6P and (]4.5.7p . using Proposition 14. 1.2] and the proof of Theorem 14.3.11 
it is enough to check that 



(n 
k=l 

\ n— >-oo n •^■^ / 

\ k=l J 



=1, 



1. 



The above relations follows by f l4.4.6p . 

By fH3:i|) and fHX6D . fHXTjl . we have gH]). 

The asymptotic distribution of the CLS estimation is given in the next theorem. 
4.5.2 Theorem. Under the additional assumptions EYq < oo and Eef < oo, we have 



□ 



(4.5.9) 



^/n{an - a) 



1 Bq,^ 



as n oo, 



where B^^e is defined in f l2.3.2p . Moreover, conditionally on the values Ys^^i and Yg 



(4.5.10) 

where 



1 C ot^eB oi,eC' 



as n ^ 00, 



Ys,-i 1 
n.-i 1 



Proof. Using Proposition 14.1.21 the proof of Theorem 14.3.21 and f l4.4.9p . (14.4. lOp . one can 
obtain (14X9]) . By (HXill and (l4X8ll . 



Vn{02,n - linifc^oo 02,k) 



"^si — 1 l^e,n (^i '-^^i — 1 f^e 

Yg2 Ol-nYs2 — l l^s,n (^2 (-^^S2 — l /^e 



-Ys.^i -1 
-Ys2-i -1 



^/n{an - a) 



holds asymptotically as n oo with probability one. Using (I4.5.9P we obtain (14.5. lOp . □ 



5 Appendix 

5.1 Lemma. If a E (0,1) and Esi < oo, then the INAR(l) model in (I2.1.ip has a unique 
stationary distribution. 

Proof. We follow the train of thoughts given in Section 6.3 in Hall and Heyde [35], but we 
also complete the proof given there. For all n G Z+, let P„ denote the probability generating 
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function of X„, i.e., Pn{s) := Es^", |s| ^ 1, s G C. Let A and B be the probability 
generating function of the offspring (^1,1) and the innovation (^i) distribution, respectively. 
With the notation 

:= ( Ao. . -o4 )(g), \s\^i, seC, keN, 

fc-times 

we get for all |s| ^ 1, s G C, and n eN, 

P„(.) = E(E(s^" I = E[E(sSS'r^«.. I j-^f_^)E(.- I 

= E{A{sf-^B{s)) = Pn-i{A{s))B{s). 

By iteration, we have 

Pn{s) = Pn-i{A{s))B{s) = PnMiA o A) {s)) B {A{s)) B {s) = ■■■ 

(5.11) 

= Po(^^"ns))5(s) n B{A'^^\s)), \s\^l, s eC, ne N. 

k=l 

We check that lim„_>oo Po(^^"ns)) = ^o(l) = 1, s e C, and verify that the sequence 
B {A^''\s)) , n eN, is convergent for all s G [0, 1]. By iteration, for all n eN, 

= A("-i)(1 -a + as) = A("-2)(1 + + as)) 

n-l 

(5.12) = A("-2)(1 - a + a(i - a) + ^2^) = . . . = (1 _ ^ a^ + a«s 

fc=0 

= (s-l)a" + l, 

and hence lim„^oo ^^"^s) = 1, s G C. Then lim„^oo i'o(^^"Hs)) = Po(l) = 1, s G C. Since 
^ B{v) ^ 1, G [0,1], V eR, we get for all s G [0,1], the sequence Yll^^B{A^^\s)), 
n G N, is nonnegative and monotone decreasing and hence convergent. 

We will use the following known theorem (see, e.g., Chung |24l Section 1.6, Theorem 4 and 
Section 1.7, Theorem 2]. Let (^n)nez+ be a homogeneous Markov chain with state space /. 
Let us suppose that there exists some subset D of I such that D is an essential, aperiodic 
class and I \ D is a subset of inessential states. Then either 

(a) for all i E I, j E D we have lim„_>oo Pi = 0, and therefore, there does not exist any 
stationary distribution, 

or 

(b) for all i,jED we have lim„_>ooPij^ := ttj > 0, and in this case the unique stationary 
distribution is given by {TCj)jei where ttj := ttj if j E D and tTj := if j E I \ D. 

Here p[^j denotes the ra-step transition probability from the state i to the state j. 
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Let us introduce the notation 

Zmin := min |z G Z+ : P(ei = i) > o|. 

Using that the offspring distribution is Bernoulh, i.e., it can take values and 1, and both 
of them with positive probabihty, since a G (0, 1), one can think it over that the set of states 
D := |z G Z+ : z ^ «min| is an essential class. Note also that I\D is a finite set of inessential 
states. The class D is aperiodic, since 

Pimin,imin = ^i^n+l = ^min I Xn = ^min) > P{en+1 = ^min)(l - > 0. 

Note that if the additional assumption P(£i = 0) > is satisfied, then the Markov chain is 
irreducible and aperiodic. 

Let us assume that there is no stationary distribution. With the notation 
Pnis) := ^ = V s'PiX^ = k + Vin), s G [0, 1], 

k=0 

we get for all n eN, 



oo oo 
P„(0) = P(X„ = Z^i,) = J2 = Vin I Xo = j)P{Xo = j) = J2ptLf(^0 = j) ■ 

j=0 j=0 

Hence, by part (a) of the above recalled theorem, we get lim„^oo Pj"^;^^ = for all j G Z+. 
Then the dominated convergence theorem yields that 

lim P„(0) = 0. 

However, we show that lim„^oo -Pn(O) > 0, which is a contradiction. Using that P{ei = 
Vin) > and that 

n-l 

k\ 



p„(o) = Po(i - «")p(£i = Vin) n - 



a 

k=l 



we have it is enough to prove that the limit of the sequence 11^=1 B(A^''^ (0)) = nfc=i -8(1 — a 
n G N, is positive. It is known that for this it is enough to verify that 

oo oo 

^(1 - B{A^''\0))) = ^(1 - B{1 - a^)) is convergent, 
fc=i fc=i 

see, e.g., Bremaud jTTl, Appendix, Theorem 1.9]. Just as in Section 6.3 in Hall and Heyde [35] . 
we show that for all s G [0, 1), Y^'^=i{l- B{A^'''>{s))) is convergent. For all A; G N, s G [0, 1), 



and, by mean value theorem, 

1 -P(AW(s)) _ P(AW(1)) -P(A(fe)(3)) _ PXg(g))(AW(l) - AW(g)) 
1- AW(s) ~ v4W(l) - AW(s) ~ AW(1) - AW(s) 
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B'ieis)), 



with some 9{s) G (s, 1). Since 

oo oo 

(5.13) B'{s) = E(£is^i-i) = J2 ks''-^P{ei = k) ^^i^^ = k) = Ee^, s G [0, 1], 

k=l k=l 

we have 

l-5MW(s)) ^ , , 

^E., = ;.., .G[0,1). 

Furthermore, by (15.121) . we get 

1 - A^''\s) ^ 1 - A^''\0) = a'' , ken, sg[0,1), 
and hence 1 - B{A^''\s)) ^ fi^a'' for all keN, se [0, 1). Then 

oo oo 

V(l - i?(AW is))) ^ V a'^ = < oo, se [0, 1). 

— ^ — ^ i — a 

k=l k=l 

Let us denote by X a random variable on {Q, A, P) with a stationary distribution for 
the Markov chain {Xn)nei+- The, by the dominated convergence theorem and part (b) of the 
above recalled theorem, we have for all j G Z+, 

oo 

lim P(X„ = j) = hm V P(X„ = J I Xo = z)P(Xo = {) 

n— >oo 71— >oo ' ' 

1=0 

oo 

= V( lim P(X„=j|Xo = z))P(Xo = ^) 

^ n— >oo ' 

i=0 

oo 

= P(X = j)$^P(Xo = = P(X = j), 

which yields that X„ converges in distribution to X as n — )■ oo. By the continuity theorem 
for probability generating functions (see, e.g.. Feller |3Tl Section 11]), we also have X has the 
probability generating function 

oo 

(5.14) P{s):=B{s)l[B{A'^'^\s)), s e (0,1). 

k=l 

The uniqueness of the stationary distribution follows by part (b) of the above recalled theorem. 
□ 

Proofs of formulae (12.2.31) . (12.2.41) and (12.2. lOp . Let us introduce the probability gener- 
ating functions 

A(s) := Es^ = 1 — a + as, s > 0, 
where ^ is a random variable with Bernoulli distribution having parameter a G (0, 1) and 

oo 

E(s) := Es" = ^ P(£ = A;)s^ s > 0, 

k=0 



97 



where £ is a non- negative integer- valued random variable with the same distribution as ei. 
In what follows we suppose that Ee^ < oo. Since a G (0, 1) and Ee < oo, by Lemma IHTT] 
there exists a uniquely determined stationary distribution of the INAR(l) model in (12.1. ip . Let 
us denote by X a random variable with this unique stationary distribution. Due to Hall and 
Heyde [351 formula (6.38)] or by the proof of Lemma \5.1\ the probability generating function 
of X takes the form 

oo 

(5.15) P{s) := E.^ = B{s)B{A{s))B{A{A{s))) ■■■ = B{s) J] B{A'^'\s)), s e (0, 1), 

fc=i 

where for all k E N, 

A^''\s) = { Ao-yoA) is), s e (0, 1). 

fc-times 

Hence for all s G (0, 1), 

log P{s) = log Es^ = log B{s) + log B{A{s)) + log B{A{A{s))) + ■■■ 

(5.16) 

= logS(s) + 5^1ogi?(AW(s)). 

k=l 

Using that Ee^ < oo, by Abel's theorem (see, e.g., Bremaud [171 Appendix, Theorems 1.2 and 
1.3]), we get 



lim I 4- log -B(s) I = lim ^ = Ee, 

sn yds ^ ' J sti Es^ 



and 



where 



lim f log B (s) \ = lim ^^"^ 



4' 



N{s) ■.=E{e{e - l){e - 2)s'-^){Es')^ + E{e{e - l)s'-^)E{es'-'){Es 
E{e{e - l)s'-^)Es' - {Ees'^'y] 2Es'E{es'-^) 
2E{es'-^)E{e{e - l)s'-^){Es')\ s G (0, 1). 



e\2 



Hence 



hm (^^logB{s)^ = E{e{e - l){e - 2)) - E{e{e - l))Ee - 2[E{e{e - 1)) - {Ee)']Ee 
= Ee^ - 3Ee^ + 2Ee - 3{Ee^ - Ee)Ee + 2{Eef. 
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(5.17) 


Ee -- 


= lim ( 

sn \ 


AlogB(.)) 


(5.18) 


Ee' 


= lim 

sn 


f d' 


(5.19) 


Ee' 


= lim 


f d' 


By (]5.16|), 









logP(s) = logEs^ = b{s) + J2b{A^'\s)), s G (0, 1], 



fc=i 



where b{s) := \ogB{s), s G (0, 1]. We show that 



(5.20) . , 

sn \ds 

First we note that 
d 



il7b;i°sP(^) =&'(!) + E 



fc=i 



fe-i 



6'(AW(1)) JJA'(AW(1)) 



logP(s) = 6'(s) + 5^ 



k=l 



6'(A('=)(s)) JJa'(AW(s)) 



£=0 



SG (0,1), 



and, by (^J^, we get for all keN, the functions b'{A^''\s)), s G [0, 1] are well-defined. We 
check that the functions b'{A^''\s)), s G [0,1], k e N, are bounded with a common bound. 
By flHTT^ . we have 

AW(s) = (s- !)«'= + 1 G [1 -a^l], SG[0,1], A; G N, 

and hence AW(s) G [1 - a, 1], s G [0, 1], keN. Then, using fl5.13p . we get 



fi(AW(s)) ^ 5(1 -a) 
Using that A'(s) = a = E^, V s > 0, and that 



< oo, s e [0, 1], A; G N. 



E 

k=l 



a 



a 



1 — a 



< oo, 



the dominated convergence theorem and (15.171) yield fl5.20p . Hence, since A{1) = 1, 
hrn (j- \ogP{s)\ =Ee + {Ee)E^ + {Eemf + " " " = E(Ee)(EO' 

Ate 



(5.21) 



Ee 



< oo. 



1 - E^ 1 - a 

Just as we derived (I5.17p . but without supposing EX < oo, Abel's theorem yields that 

d 



EX = lim — log P(s' 
sti yds 
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By f l5.2ip . we get EX = ^3^, which also shows that EX is finite. 
Using that 

B"is)Bis) - iB'is)r 
bis) = , .€(0,1), 

we get 

(5(1 - a)y 

Using also that b"{l) = E{e{e - 1)) - (Ee)^ and A"{s) = 0, s > 0, by the dominated 
convergence theorem, one can check that 

fe-i \ 2 00 



— logP(s) =b"{l) + Y,b"{A('^\l))ll[A'{A\l))] =6"(1)$^(E0 

/ I — 1 \ f—rt I I — n 



k=l \l=Q / A:=0 

E{e{e - I)) - {Eef Vare-Ee - /x. 



1 - (EO^ 1 - a2 1 - a2 ' 

which implies that EX^ is finite and 

tA — + h -; ^ — —. n r 



l-a2 1-a (l-a)2 I - - af 

By a similar argument, using that Ee^ < 00 and 

h"\l) = £{e{e -l){e- 2)) - 3(E£)(E£(£ - 1)) + 2{Eef, 

we get 

Hm(^logP(.)) =r(l) + f;6'"(/lW(l)) rnA'(A^(l))'j 

^ E(e(g - l)(g - 2)) - 3(Ee)(Ee(e - 1)) + 2{£ef 

1 - (EO-^ 

_ Ee3 - 3Ee2 + 2Ee - 3Ee(E£2 - Ee) + 2(E£)3 



1 — Q;'^ 1 — 

which implies that EX^ is finite and 



P3 _Ee3-3(T^(i + ^^) a^ + afie „ f^e 



1 — a'^ 1 — 1 — a 



(l-a)(l-a2) (l-a)3- 

This yields (12.2. lOp . One can also write (I2.2.10p in the following form 
1 



EX^ 



3a^(l - a)EX^ + 3aXEX^ + 3aEX(< + /x^) + Et^ + 3a(l - a)/i^EX 
+a(l - a)(l - 2a)EX . 



□ 
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5.2 Lemma. Let {Xn)n&7.+ o,nd {Zn)n&+ be two (not necessarily homogeneous) Markov 
chains with state space Let us suppose that {Xn, Zn)n&+ is a Markov chain, Xq and 
Zq are independent, and that for all n G N and i,j, k,£ E Z+ such that P(X„_i = k, Zn-i = 
i)>0, 

P(X„ = t,Zn = j\ = k, = £) = P(X„ = 1 1 X„_i = k)P{Z^ = J I = i). 
Then (X„)„gz+ o,nd {Zn)n&+ o^re independent. 
Proof. For all n G N and io, «i, • • • , in,jo,ji, • • • , jn e Z+, we get 

P{Xn = in, ■ ■ ■ , Xq = io, Zn = jn, ■ ■ ■ , Zq = jo) 

= P{Xn = in, Zn = jn \ Xn-1 = in-1, = jn-l) ' ' ' P(-^l = H, Z\ = ji \ Xq = Zq, Zq = jo) 

X P(Xo = io,Zo = jo) 
= P(X„ = Zn I Xn-1 = Zn-l) " " " P{X^ =h\Xo = 2o)P(^0 = ^o) 

X P{Zn = jn I Zn-1 = j„_l) " • ' P(^l = Jl | Zq = jo)P(^0 = jo) 
= P{Xn = in, ■ ■ ■ , Xq = 'io)P(^n = jn, ■ ■ ■ , Zq = jo), 

which yields that Xn, ■ ■ ■ , Xq and Zn, ■ ■ ■ , Zq are independent. One can think it over that 
this implies the statement. □ 

The following result can be found in several textbooks, see, e.g.. Theorem 3.6 in Bhat- 
tacharya and Waymire [11], Chapter 0]. For completeness we give a proof. 

5.3 Lemma. Let {C,n)n&'N be a sequence of random variables such that P(lim„_j.oo ■Cn = 
0) = 1 and {C,n '■ n E N} is uniformly integrable for some p G N, i.e., 

limM^oo sup„gpj E (|Cn|^l{|e„|>Af}) = 0. Then ^„ as n -> oo, i.e., lim„^oo E|^„|p = 0. 
Proof. For all n eN and M > 0, we get 

E|e„r = E {\U'M\ir.\^>M}) + E (|enri{|C„KA/}) ^ sup E {\WM\ir.\^>M}) + E (|enri{|5„|P<M}) . 

neN 

By P(lim„^oo = 0) = 1, 

lim |Cn('^)ri{|5„H|p«;A/} = 0, y u) En, 

n— >-oo 

and E (|^n|^l{|5„|Ps£A/}) ^ < oo for all n G M. Hence, by dominated convergence theorem, 
we have 

lim E{\WM\^„\^^M}) =0 

for all M > 0. Then 

lim sup E|e„r ^ sup E (|enri{|5„|p>Af}) , V M > 0. 

By the uniformly integrability of {^^ : n E N}, we have limM^oo sup„gpj E {\^n\^l{\(„\p>M}) = 0, 
which yields the assertion. □ 
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